-- Logs begin at Wed 2022-02-16 08:47:17 UTC, end at Wed 2022-02-16 09:46:20 UTC. -- Feb 16 09:13:27.472304 dv-cinder-828459-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 16 09:13:27.482227 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Feb 16 09:13:27 2022] *** Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: nodename: dv-cinder-828459-1-iscsi Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: machine: x86_64 Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: clock source: unix Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: pcre jit disabled Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: detected number of CPU cores: 4 Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: current working directory: / Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: detected binary path: /usr/bin/uwsgi-core Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: your processes number limit is 47680 Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: your memory page size is 4096 bytes Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: detected max file descriptor number: 2048 Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: lock engine: pthread robust mutexes Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: thunder lock: enabled Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 16 09:13:27.485390 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 16 09:13:27.531651 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: Python main interpreter initialized at 0x5564440c19c0 Feb 16 09:13:27.531651 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: python threads support enabled Feb 16 09:13:27.531651 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: your server socket listen backlog is limited to 100 connections Feb 16 09:13:27.531651 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: your mercy for graceful operations on workers is 90 seconds Feb 16 09:13:27.532004 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: mapped 403077 bytes (393 KB) for 2 cores Feb 16 09:13:27.532091 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: *** Operational MODE: preforking *** Feb 16 09:13:27.534279 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: *** uWSGI is running in multiple interpreter mode *** Feb 16 09:13:27.534279 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: spawned uWSGI master process (pid: 79261) Feb 16 09:13:27.532569 dv-cinder-828459-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 16 09:13:27.535898 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: spawned uWSGI worker 1 (pid: 79275, cores: 1) Feb 16 09:13:27.535898 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: spawned uWSGI worker 2 (pid: 79276, cores: 1) Feb 16 09:13:27.536176 dv-cinder-828459-1-iscsi devstack@keystone.service[79261]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 16 09:13:33.606270 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 09:13:33.606270 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: from cryptography.utils import int_from_bytes Feb 16 09:13:33.607102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 09:13:33.607102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: from cryptography.utils import int_from_bytes Feb 16 09:13:33.607708 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 09:13:33.607708 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: from cryptography.utils import int_from_bytes Feb 16 09:13:33.608185 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 09:13:33.608185 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: from cryptography.utils import int_from_bytes Feb 16 09:13:33.655015 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 09:13:33.655191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 09:13:33.655381 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] command line args: [] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 09:13:33.655655 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 09:13:33.655832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ================================================================================ {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 09:13:33.656117 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] admin_token = **** {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.656368 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] config_dir = [] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.656456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 09:13:33.656601 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.656687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 09:13:33.656755 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] config_source = [] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.656815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] command line args: [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 09:13:33.656972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] debug = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.657064 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 09:13:33.657126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.659899 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ================================================================================ {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 09:13:33.659973 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660220 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] admin_token = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660401 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] config_dir = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660401 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660507 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] config_source = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] list_limit = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] log_config_append = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] debug = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660847 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660847 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] log_dir = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.660953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] log_file = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661114 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661236 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661483 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661671 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_config_append = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_dir = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.661950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662006 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_file = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662070 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662138 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662202 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662386 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662449 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662507 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662572 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662731 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662794 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662909 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.662966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.663028 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.663028 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.663153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.90/identity {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.663218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.663276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] publish_errors = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.663340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.663399 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.664238 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.664425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.664425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.664805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.665038 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.665203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.665395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.665395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] standard_threads = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.665760 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.90/identity {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.665984 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.666154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] publish_errors = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.666437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.666626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.666851 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.667021 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.667217 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] use_journal = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.667408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.667603 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] use_json = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.667816 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.668054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] use_stderr = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.668054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] use_syslog = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.668393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.668576 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.668767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] standard_threads = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.668929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.669071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.669242 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.669388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.669388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.669777 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.669920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] use_journal = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.670074 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.670245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] use_json = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.670245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] use_stderr = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.670517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.670651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] use_syslog = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.670785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.670922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 09:13:33.671055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.671188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.671316 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.671442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.671575 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.671778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.671914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.672068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.672210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.672338 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.672473 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.672601 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.672733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.672866 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.672995 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.673127 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.673263 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.673391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.673518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.673693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.673846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.674156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.674300 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.674435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.674568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.674701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.674828 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.674961 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.675097 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.675225 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.675351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.675483 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.675611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.675744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.675891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.676047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.676193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.676322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.676454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.676588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.676726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.676854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.676987 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.677116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.677243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.677369 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.677651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.677795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.677929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.678063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.678192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.678319 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.678521 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.678650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.678776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.678908 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.679035 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.679161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.679300 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.679437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.679574 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.679702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.679828 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.679960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.680149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.680280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.680408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.680540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.680667 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.680793 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.680927 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.681060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.681187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.681315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.681457 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.681590 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.681724 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.681852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.681978 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.682105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.682231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.682367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.682536 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.682668 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.682795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.682922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.683048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.683183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.684425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.684644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.684847 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.685015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.685207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.685434 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.685602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.685855 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.686053 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.686221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.686418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.686648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.686814 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.687052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.687223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.687415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.687654 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.687858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.688050 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.688217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.688408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.688599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.688791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.689021 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.689704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.689889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.690104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.690238 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.690456 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.690592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.690722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.690894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.691027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.691162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.691292 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.691420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.691586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.691720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.691850 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.691985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.691985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.692308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.692438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.692576 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.692705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.692834 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.692993 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.693126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.693254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.693393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.693523 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.693650 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.693777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.693916 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.694045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.694300 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.694449 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.694580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.694580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.694822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.694951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.695156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.695298 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.695427 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.695589 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.695749 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.695882 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.696047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.696182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.696311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.696447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.696576 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.696704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.696840 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.696976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.697105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.697233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.697361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.697489 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.697625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.697763 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.697891 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.698020 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.698148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.698283 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.698424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.698424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.698956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.698956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.699198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.699326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.699454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.699714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.699864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.700005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.700169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.700298 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.700298 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.700550 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.700679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.700806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.700934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.701061 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.701195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.701332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.701461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.701588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.701717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] auth.external = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.701854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.701982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.702123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.702259 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.702391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.702519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.702647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.702774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] auth.password = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.702909 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.703043 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] auth.token = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.703177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.703331 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.703469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.703609 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.703739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.external = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.703867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.704002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.704162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.704293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.704424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.704552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.704688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.704830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.password = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.705522 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.705692 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] auth.token = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.705869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] credential.caching = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.706015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.706215 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.706361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.706493 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.706622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.706752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.706880 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.707017 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.707153 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.707283 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.707410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.707614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.707761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.707902 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.708059 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.708195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.708333 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.708464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.708593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.708731 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.708861 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.708991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.709120 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.709249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.709378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.709378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.709642 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.709780 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.709921 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.710050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.710179 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.710316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.710453 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] federation.caching = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.710453 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.710696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.710831 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.710961 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.711099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.711229 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.711358 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.711486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.711621 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.711765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.711971 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.712166 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.712297 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.712442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.712634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.712797 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.712941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.713072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.713201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.713331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.713460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.713596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.713744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.caching = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.713875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.714004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.714133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.714262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.714390 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.714528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.714657 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.714786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.714916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.715045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.715173 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.715310 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.715454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.715584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.715712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.715841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.715971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.716137 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.716269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.716398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.716527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.716657 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.716785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.716922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.717052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.717181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.717320 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.717450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.717579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.717716 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.717846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.718043 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.718043 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.718295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.718434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.718571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.718701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.718830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.718967 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.719107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.719245 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.719385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.719521 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.719650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.719780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.719780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.720064 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.720201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.720330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.720489 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.720653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.720932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.721095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.721240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.721369 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.721498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.721627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.721756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.721892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.722023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.722153 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.722283 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.722412 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.722547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.722685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.722815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.722944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.723082 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.723212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.723437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.723608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.723742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.723877 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.724008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.724193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.724324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.724464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.724595 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.724724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.724854 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.724993 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.725123 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.725264 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.725396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.725525 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.725654 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.725784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.725912 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.726049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.726179 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.726309 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.726438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.726567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.726696 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.726843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.726973 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.727102 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.727231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.727359 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.727489 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.727626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.727756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.727884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.728014 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.728175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.728175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.728437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.728574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.728714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.728843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.728972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.729101 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.729247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.729378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.729508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.729637 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.729803 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.729936 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.730073 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.730203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.730332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.730332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.730586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.730715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.730853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.730983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.731117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.731247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.731375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.731504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.731641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.731641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.731891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.732041 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.732178 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.732327 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.732464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.732593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.732723 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.732852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.732980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.733117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.733247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.733375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.733503 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.733632 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.733761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.733897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.734027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.734169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.734297 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.734426 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.734554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.734691 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.734822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.734950 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.735079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.735213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.735342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.735342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.735593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.735723 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.735861 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.735990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.736164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.736311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.736448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.736578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.736706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.736872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.737008 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.737147 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.737278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.737407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] resource.caching = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.737536 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.737665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.737813 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.738018 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.738157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.738294 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.738430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.738565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.738700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.738844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.738994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.739136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.739271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.739406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.739542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.739687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.739842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.739982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.740165 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.740302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] role.caching = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.740436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.740583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] role.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.740720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.740856 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.740990 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.741126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.741261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.741404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.741540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.741685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.741821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.741956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.742091 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.742234 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.742371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.742505 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.742639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.742774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.742908 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] role.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.743052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.743188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] role.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.743324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.743459 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.743604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.743739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.743882 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.744019 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.744179 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.744316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.744451 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.744586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.744586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.744856 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.744991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.745126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.745262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.745415 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.745552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.745687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.745822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.745957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.746092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.746236 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.746373 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.746508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.746643 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.746779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.746914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.747057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.747057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.747324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.747461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.747596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.747768 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.747919 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.748108 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.748250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.748386 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.748522 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.748657 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.748807 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.748950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.749096 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.749238 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.749374 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.749510 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.749653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.749790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.749924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.750059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] token.caching = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.750193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.750371 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.750521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.750658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.750793 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.750928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.751077 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.751248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.751396 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.751537 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.751673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.752555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.752697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.752697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.752967 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.753104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.753240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.753375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.753511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.753647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.753802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.753940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.754075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.754075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.754332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.754476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.754613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.754750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.754887 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.755022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.755158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.755301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.755438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.755438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.755706 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.755843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.755979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.connection = **** {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.756152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.756299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.756444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.756580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.756754 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.756892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.757029 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.757165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.757309 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.757446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.757593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.757730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.757867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.758004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.758004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.758270 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.758406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.758542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.connection = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.758686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.758830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.758968 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.759112 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.759249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.759391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.759545 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.759682 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.759818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.759963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.759963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.760305 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.760442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.760578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.760714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.760933 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.761073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.761209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.761209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 09:13:33.761479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.761479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.761479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.761479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.761479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.761479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.761479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.761479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.761479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 09:13:33.762611 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 09:13:33.773621 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.773860 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.774093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.775483 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.775771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.776005 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.782940 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.785679 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.812765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.813040 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.813807 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.814043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.867991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.869903 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.918361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.918737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.919886 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.920155 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.987149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.987400 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.987594 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.987730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.987824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.988048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.988156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.988296 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.988445 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.988725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.989003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:33.989279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.012273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.012529 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.012737 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.012964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.013186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.013407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.013578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.013678 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.013913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.014868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.014868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.015013 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.015261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.015535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.025635 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.026722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.039180 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.039345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.039506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.039602 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.039702 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.039917 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.040039 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.040175 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.040379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.040486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.040620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.040859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.041046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.041261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 09:13:34.059624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.059789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.059942 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 09:13:34.060107 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 09:13:34.060313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.060461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.060567 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 09:13:34.060761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 09:13:34.060855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.061024 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.061186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.061277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.061532 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.061622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.061891 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.062209 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.073352 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.073637 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.073906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.074002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.074185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.074345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.074680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.075024 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.082404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.083290 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.085671 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.085954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.086235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.086516 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.086800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.086928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.087058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.087296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.087427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.087583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.087750 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.087878 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.088139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.088283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.088412 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.088606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.088927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.089254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.089589 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.089918 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.090252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.090582 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.117010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.118656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.118898 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.119515 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.121210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.121559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.124095 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.127724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.128116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.225325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.225675 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.229967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.233205 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.233495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.238794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.239080 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.239364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.239646 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.239921 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.240251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.240394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.240658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.240801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.240943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.245288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.245647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.245994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.246343 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.246687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.247025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.247359 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.247850 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.259794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.260096 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.264937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.267196 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.267603 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.268664 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.268960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.272768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.273917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.276581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.276945 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.277563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.281187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.281490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.281776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.282070 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.282284 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.282413 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.282737 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.286855 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.290514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.290879 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.291226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.291583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.291925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.292288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.302774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.303071 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.303342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.303608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.311484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.312059 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.312411 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.312757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.313084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.313211 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.313472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.316558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.316845 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.317133 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.317416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.317713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.321664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.323518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.323859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.326997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.327345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.327694 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.328047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.328402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.331447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.331721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.332054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.332310 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.332598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.332891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.333170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.347137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.347414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.347692 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.347974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.348296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.348578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.348851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.351615 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.355078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.363826 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.365608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.367343 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.367724 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.368135 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.372058 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.375238 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.375646 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.378091 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.378801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.380405 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.381617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.381994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.382090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.382266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.382538 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.382620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.382970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.389947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.391501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.392981 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.393382 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.393764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.395253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.395545 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.395830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.396127 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.402301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.402682 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.403058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.403451 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.403820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.404220 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.404598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.404971 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.405109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.405395 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.405475 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.405669 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.405911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.406275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.406656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.407036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.407391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.415265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 09:13:34.415542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.415907 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.416221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.416492 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.416778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.417060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.417324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.417588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.417866 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.418132 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.418409 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.418684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.418942 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 09:13:34.448563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5564440c19c0 pid: 79275 (default app) Feb 16 09:13:34.452043 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f21d2-002f-4307-9164-c6d2a7995b59 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:34.452434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f21d2-002f-4307-9164-c6d2a7995b59 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:34.452808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f21d2-002f-4307-9164-c6d2a7995b59 None None] PATH_INFO: `/v3` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:34.456733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5564440c19c0 pid: 79276 (default app) Feb 16 09:13:34.457859 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1/1] 10.222.0.90 () {50 vars in 791 bytes} [Wed Feb 16 09:13:34 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:42.900584 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c256ff-aef7-4c6b-b080-7d3b11a65ccb None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:42.901163 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c256ff-aef7-4c6b-b080-7d3b11a65ccb None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:42.901163 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c256ff-aef7-4c6b-b080-7d3b11a65ccb None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:42.906104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1/2] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:13:42.911333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c4ec1-68d6-4a23-95cc-051494154264 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:42.911816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c4ec1-68d6-4a23-95cc-051494154264 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:42.911899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c4ec1-68d6-4a23-95cc-051494154264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:42.943990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG oslo_db.sqlalchemy.engines [None req-e07c4ec1-68d6-4a23-95cc-051494154264 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 09:13:43.130947 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG passlib.handlers.bcrypt [None req-e07c4ec1-68d6-4a23-95cc-051494154264 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79275) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 16 09:13:43.131360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG passlib.handlers.bcrypt [None req-e07c4ec1-68d6-4a23-95cc-051494154264 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79275) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 16 09:13:43.186799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-e07c4ec1-68d6-4a23-95cc-051494154264 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:43.188344 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e07c4ec1-68d6-4a23-95cc-051494154264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:43.310388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 2/3] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:13:43.493503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c256ff-aef7-4c6b-b080-7d3b11a65ccb None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:43.528702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG oslo_db.sqlalchemy.engines [None req-07c256ff-aef7-4c6b-b080-7d3b11a65ccb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 09:13:43.654254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c256ff-aef7-4c6b-b080-7d3b11a65ccb None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:43.658547 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb736e6b-199b-4f04-940c-b65f6dd54989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:43.659188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb736e6b-199b-4f04-940c-b65f6dd54989 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:43.659466 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb736e6b-199b-4f04-940c-b65f6dd54989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:43.659741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb736e6b-199b-4f04-940c-b65f6dd54989 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:43.667593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb736e6b-199b-4f04-940c-b65f6dd54989 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:43.718803 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bb736e6b-199b-4f04-940c-b65f6dd54989 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 16 09:13:43.719142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb736e6b-199b-4f04-940c-b65f6dd54989 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:43.729960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 2/4] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:13:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 09:13:43.736438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c4ec1-68d6-4a23-95cc-051494154264 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:43.753270 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c4ec1-68d6-4a23-95cc-051494154264 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:43.757690 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec61c7-e55f-487c-8a1b-59355a2c06c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:43.758790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec61c7-e55f-487c-8a1b-59355a2c06c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:43.759078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec61c7-e55f-487c-8a1b-59355a2c06c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:43.759357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec61c7-e55f-487c-8a1b-59355a2c06c2 admin admin] PATH_INFO: `/v3/projects/452aa210ed214b4b8bc6178a127c766b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:43.760867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec61c7-e55f-487c-8a1b-59355a2c06c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=452aa210ed214b4b8bc6178a127c766b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:43.821593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3cec61c7-e55f-487c-8a1b-59355a2c06c2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 16 09:13:43.821935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec61c7-e55f-487c-8a1b-59355a2c06c2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:43.826484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 3/5] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:13:43 2022] GET /identity/v3/projects/452aa210ed214b4b8bc6178a127c766b => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:46.124188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f260f5-b7ce-4371-b901-13a408f7136a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:46.124723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f260f5-b7ce-4371-b901-13a408f7136a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:46.124723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f260f5-b7ce-4371-b901-13a408f7136a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:46.129389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 3/6] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:13:46.134792 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab1531-f9d4-484e-92a5-e11d7e0a2e29 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:46.135219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab1531-f9d4-484e-92a5-e11d7e0a2e29 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:46.135341 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab1531-f9d4-484e-92a5-e11d7e0a2e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:46.154632 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-71ab1531-f9d4-484e-92a5-e11d7e0a2e29 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:46.156146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-71ab1531-f9d4-484e-92a5-e11d7e0a2e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:46.164534 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 4/7] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:13:46.186724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f260f5-b7ce-4371-b901-13a408f7136a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:46.198962 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f260f5-b7ce-4371-b901-13a408f7136a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:46.203167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42d6e4-59dc-4ffa-94a4-6a659c63d838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:46.203792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42d6e4-59dc-4ffa-94a4-6a659c63d838 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:46.204105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42d6e4-59dc-4ffa-94a4-6a659c63d838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:46.205158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42d6e4-59dc-4ffa-94a4-6a659c63d838 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:46.212816 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42d6e4-59dc-4ffa-94a4-6a659c63d838 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:46.214606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42d6e4-59dc-4ffa-94a4-6a659c63d838 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:46.224002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 4/8] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:13:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:13:46.229370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab1531-f9d4-484e-92a5-e11d7e0a2e29 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:46.238236 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab1531-f9d4-484e-92a5-e11d7e0a2e29 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:46.242671 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa20ad36-9869-457b-9c03-7855cffe531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:46.243515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20ad36-9869-457b-9c03-7855cffe531b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:46.243794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20ad36-9869-457b-9c03-7855cffe531b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:46.244098 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20ad36-9869-457b-9c03-7855cffe531b admin admin] PATH_INFO: `/v3/users/7b109de6a86e43399a6192c2887dcf96` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:46.245466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20ad36-9869-457b-9c03-7855cffe531b admin admin] RBAC: Authorizing `identity:get_user(user_id=7b109de6a86e43399a6192c2887dcf96)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:46.247270 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa20ad36-9869-457b-9c03-7855cffe531b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:46.248831 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 5/9] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:13:46 2022] GET /identity/v3/users/7b109de6a86e43399a6192c2887dcf96 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:48.667390 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b8b14-a04a-4d68-9877-122ac7f01c4f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:48.667917 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b8b14-a04a-4d68-9877-122ac7f01c4f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:48.668043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b8b14-a04a-4d68-9877-122ac7f01c4f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:48.669728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 5/10] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:13:48.675050 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4298243-4d64-4dc2-b4bf-f133f64934e7 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:48.675448 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4298243-4d64-4dc2-b4bf-f133f64934e7 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:48.675711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4298243-4d64-4dc2-b4bf-f133f64934e7 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:48.676230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35723b6-4c86-4706-9347-351b8f9ded7e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:48.676521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35723b6-4c86-4706-9347-351b8f9ded7e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:48.676797 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35723b6-4c86-4706-9347-351b8f9ded7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:48.677800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 6/11] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:13:48.683045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26624e55-ad56-4097-902b-1ae4c5249014 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:48.683330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26624e55-ad56-4097-902b-1ae4c5249014 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:48.683606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26624e55-ad56-4097-902b-1ae4c5249014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:48.701216 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-26624e55-ad56-4097-902b-1ae4c5249014 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:48.702394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-26624e55-ad56-4097-902b-1ae4c5249014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:48.710028 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 7/12] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:13:48.718875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG passlib.handlers.bcrypt [None req-e35723b6-4c86-4706-9347-351b8f9ded7e None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79276) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 16 09:13:48.719290 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG passlib.handlers.bcrypt [None req-e35723b6-4c86-4706-9347-351b8f9ded7e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79276) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 16 09:13:48.733033 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26624e55-ad56-4097-902b-1ae4c5249014 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:48.742257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26624e55-ad56-4097-902b-1ae4c5249014 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:48.746697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f44308-338e-43dc-83b5-e2d6bfd22088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:48.747460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f44308-338e-43dc-83b5-e2d6bfd22088 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:48.747740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f44308-338e-43dc-83b5-e2d6bfd22088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:48.748012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f44308-338e-43dc-83b5-e2d6bfd22088 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:48.762146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f44308-338e-43dc-83b5-e2d6bfd22088 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:13:48.768651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e35723b6-4c86-4706-9347-351b8f9ded7e None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:48.769526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-f6f44308-338e-43dc-83b5-e2d6bfd22088 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:13:48.770252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e35723b6-4c86-4706-9347-351b8f9ded7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:48.770686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 8/13] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:13:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:13:48.776087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f44308-338e-43dc-83b5-e2d6bfd22088 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:48.785430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f44308-338e-43dc-83b5-e2d6bfd22088 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:48.789734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bc3ad-88b3-47d8-819f-3f2184303524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:48.790344 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bc3ad-88b3-47d8-819f-3f2184303524 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:48.790629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bc3ad-88b3-47d8-819f-3f2184303524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:48.790909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bc3ad-88b3-47d8-819f-3f2184303524 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:48.791643 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bc3ad-88b3-47d8-819f-3f2184303524 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:13:48.791945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bc3ad-88b3-47d8-819f-3f2184303524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:48.792806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 6/14] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:13:48.793788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-af9bc3ad-88b3-47d8-819f-3f2184303524 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:13:48.793788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:13:48.793788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:13:48.794686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bc3ad-88b3-47d8-819f-3f2184303524 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:48.808208 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 9/15] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:13:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:13:48.813487 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35723b6-4c86-4706-9347-351b8f9ded7e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:48.816336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bc3ad-88b3-47d8-819f-3f2184303524 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:48.824068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35723b6-4c86-4706-9347-351b8f9ded7e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:48.828451 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8834bef-63f0-4ccd-838f-340a63a03f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:48.829974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8834bef-63f0-4ccd-838f-340a63a03f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:48.830256 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8834bef-63f0-4ccd-838f-340a63a03f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:48.830530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8834bef-63f0-4ccd-838f-340a63a03f69 admin admin] PATH_INFO: `/v3/users/7b109de6a86e43399a6192c2887dcf96` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:48.832159 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8834bef-63f0-4ccd-838f-340a63a03f69 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b109de6a86e43399a6192c2887dcf96)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:48.834065 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8834bef-63f0-4ccd-838f-340a63a03f69 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:48.835839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 7/16] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:13:48 2022] GET /identity/v3/users/7b109de6a86e43399a6192c2887dcf96 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:48.835952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bc3ad-88b3-47d8-819f-3f2184303524 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:48.840387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3c76f-ee81-4277-b640-67dfa4202474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:48.841027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3c76f-ee81-4277-b640-67dfa4202474 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:48.841131 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8834bef-63f0-4ccd-838f-340a63a03f69 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:48.841313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3c76f-ee81-4277-b640-67dfa4202474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:48.841586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3c76f-ee81-4277-b640-67dfa4202474 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:48.849668 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3c76f-ee81-4277-b640-67dfa4202474 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:48.850331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8834bef-63f0-4ccd-838f-340a63a03f69 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:48.851460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3c76f-ee81-4277-b640-67dfa4202474 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:48.854636 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c89ae-9d50-48bc-adf3-b81a24ad5b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:48.855390 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c89ae-9d50-48bc-adf3-b81a24ad5b5b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:48.855671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c89ae-9d50-48bc-adf3-b81a24ad5b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:48.855944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c89ae-9d50-48bc-adf3-b81a24ad5b5b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:48.857136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c89ae-9d50-48bc-adf3-b81a24ad5b5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:48.858795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c89ae-9d50-48bc-adf3-b81a24ad5b5b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:48.860298 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 10/17] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:13:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 09:13:48.864161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 8/18] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:13:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:13:48.866210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3c76f-ee81-4277-b640-67dfa4202474 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:48.866748 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c89ae-9d50-48bc-adf3-b81a24ad5b5b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:48.874628 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3c76f-ee81-4277-b640-67dfa4202474 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:48.875968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c89ae-9d50-48bc-adf3-b81a24ad5b5b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:48.879648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4db64-4971-493a-9c08-b3a3bfa69457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:48.880437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4db64-4971-493a-9c08-b3a3bfa69457 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:48.880718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4db64-4971-493a-9c08-b3a3bfa69457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:48.880944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1654e-98f5-49e0-a5cf-1d1f88de4f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:48.881059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4db64-4971-493a-9c08-b3a3bfa69457 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:48.881546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1654e-98f5-49e0-a5cf-1d1f88de4f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:48.881825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1654e-98f5-49e0-a5cf-1d1f88de4f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:48.882100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1654e-98f5-49e0-a5cf-1d1f88de4f31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:48.882195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4db64-4971-493a-9c08-b3a3bfa69457 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:48.882906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1654e-98f5-49e0-a5cf-1d1f88de4f31 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.domain.id=default, user.id=7b109de6a86e43399a6192c2887dcf96) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:13:48.883212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1654e-98f5-49e0-a5cf-1d1f88de4f31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:48.883779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4db64-4971-493a-9c08-b3a3bfa69457 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:48.884917 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-fac1654e-98f5-49e0-a5cf-1d1f88de4f31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:13:48.884917 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:13:48.884917 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:13:48.885353 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 11/19] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:13:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:48.886063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1654e-98f5-49e0-a5cf-1d1f88de4f31 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:48.898590 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 9/20] 10.222.0.90 () {56 vars in 1343 bytes} [Wed Feb 16 09:13:48 2022] GET /identity/v3/role_assignments?user.id=7b109de6a86e43399a6192c2887dcf96&scope.domain.id=default&role.id=0e45946c6336419abb2015d8916e31ca => generated 233 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:13:51.696639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b426a-ac1a-4b31-81f7-1fd9b5f1b759 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:51.697665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b426a-ac1a-4b31-81f7-1fd9b5f1b759 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:51.698140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b426a-ac1a-4b31-81f7-1fd9b5f1b759 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:51.700444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 12/21] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:13:51.706584 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df471a9-0be8-4cb9-98e2-90f7efda8c32 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:51.707530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df471a9-0be8-4cb9-98e2-90f7efda8c32 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:51.708012 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df471a9-0be8-4cb9-98e2-90f7efda8c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:51.735912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3df471a9-0be8-4cb9-98e2-90f7efda8c32 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:51.737489 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3df471a9-0be8-4cb9-98e2-90f7efda8c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:51.745757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 10/22] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:13:51.782334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df471a9-0be8-4cb9-98e2-90f7efda8c32 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:51.782885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360683b-3010-4b8b-b081-8864d720ddc9 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:51.783419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360683b-3010-4b8b-b081-8864d720ddc9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:51.783894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360683b-3010-4b8b-b081-8864d720ddc9 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:51.786146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 13/23] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:13:51.791424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f14e15-8bf7-4e38-b016-4d01396014cd None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:51.791945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f14e15-8bf7-4e38-b016-4d01396014cd None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:51.792166 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df471a9-0be8-4cb9-98e2-90f7efda8c32 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:51.792469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f14e15-8bf7-4e38-b016-4d01396014cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:51.797147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e135-6ee1-47cc-8c14-707cce7439e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:51.799061 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e135-6ee1-47cc-8c14-707cce7439e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:51.799553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e135-6ee1-47cc-8c14-707cce7439e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:51.800017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e135-6ee1-47cc-8c14-707cce7439e3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:51.815074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e135-6ee1-47cc-8c14-707cce7439e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:13:51.822456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-d492e135-6ee1-47cc-8c14-707cce7439e3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:13:51.824226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 11/24] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:13:51.825029 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-04f14e15-8bf7-4e38-b016-4d01396014cd None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:51.826249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-04f14e15-8bf7-4e38-b016-4d01396014cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:51.830423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e135-6ee1-47cc-8c14-707cce7439e3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:51.838145 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 14/25] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:13:51.841359 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e135-6ee1-47cc-8c14-707cce7439e3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:51.846838 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3dcff-308a-4550-ac17-6e5c60ab7e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:51.847705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3dcff-308a-4550-ac17-6e5c60ab7e08 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:51.848205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3dcff-308a-4550-ac17-6e5c60ab7e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:51.848697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d3dcff-308a-4550-ac17-6e5c60ab7e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:51.849630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3dcff-308a-4550-ac17-6e5c60ab7e08 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:13:51.850188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3dcff-308a-4550-ac17-6e5c60ab7e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:51.851392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-41d3dcff-308a-4550-ac17-6e5c60ab7e08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:13:51.851392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:13:51.851392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:13:51.852676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d3dcff-308a-4550-ac17-6e5c60ab7e08 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:51.863060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f14e15-8bf7-4e38-b016-4d01396014cd None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:51.867234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 12/26] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:13:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:13:51.872365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3dcff-308a-4550-ac17-6e5c60ab7e08 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:51.882219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f14e15-8bf7-4e38-b016-4d01396014cd None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:51.882880 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d3dcff-308a-4550-ac17-6e5c60ab7e08 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:51.887721 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ea57e-0bd9-446a-9fc5-1c929da1f6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:51.888694 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ea57e-0bd9-446a-9fc5-1c929da1f6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:51.888979 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ea57e-0bd9-446a-9fc5-1c929da1f6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:51.889254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ea57e-0bd9-446a-9fc5-1c929da1f6b8 admin admin] PATH_INFO: `/v3/users/7b109de6a86e43399a6192c2887dcf96` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:51.890946 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ea57e-0bd9-446a-9fc5-1c929da1f6b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b109de6a86e43399a6192c2887dcf96)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:51.892200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b755265-d0ce-4b4c-a598-3215c1459442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:51.893304 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755265-d0ce-4b4c-a598-3215c1459442 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:51.893714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ea57e-0bd9-446a-9fc5-1c929da1f6b8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:51.893983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755265-d0ce-4b4c-a598-3215c1459442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:51.894816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b755265-d0ce-4b4c-a598-3215c1459442 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:51.895581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 13/27] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:13:51 2022] GET /identity/v3/users/7b109de6a86e43399a6192c2887dcf96 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:51.900792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ea57e-0bd9-446a-9fc5-1c929da1f6b8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:51.907034 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b755265-d0ce-4b4c-a598-3215c1459442 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:51.909799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b755265-d0ce-4b4c-a598-3215c1459442 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:51.911162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ea57e-0bd9-446a-9fc5-1c929da1f6b8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:51.928290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-9b755265-d0ce-4b4c-a598-3215c1459442 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:13:51.929719 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44774a46-6426-4137-bed1-ef4c96180107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:51.930378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 15/28] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:13:51.930560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44774a46-6426-4137-bed1-ef4c96180107 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:51.935217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44774a46-6426-4137-bed1-ef4c96180107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:51.935217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44774a46-6426-4137-bed1-ef4c96180107 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:51.935217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44774a46-6426-4137-bed1-ef4c96180107 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:51.935217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44774a46-6426-4137-bed1-ef4c96180107 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:51.935503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 14/29] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:13:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:51.936602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b755265-d0ce-4b4c-a598-3215c1459442 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:51.945782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44774a46-6426-4137-bed1-ef4c96180107 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:51.962324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b755265-d0ce-4b4c-a598-3215c1459442 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:51.966897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44774a46-6426-4137-bed1-ef4c96180107 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:51.973112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149d506-5539-454a-9308-57dd0eccde5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:51.974545 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149d506-5539-454a-9308-57dd0eccde5c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:51.975504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149d506-5539-454a-9308-57dd0eccde5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:51.976360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149d506-5539-454a-9308-57dd0eccde5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:51.977761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149d506-5539-454a-9308-57dd0eccde5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:13:51.978757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149d506-5539-454a-9308-57dd0eccde5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:51.979541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a2d62-0dd4-425a-a85d-9ec046af9cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:51.980824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-b149d506-5539-454a-9308-57dd0eccde5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:13:51.980824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:13:51.980824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:13:51.982018 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a2d62-0dd4-425a-a85d-9ec046af9cee admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:51.982518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a2d62-0dd4-425a-a85d-9ec046af9cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:51.983685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149d506-5539-454a-9308-57dd0eccde5c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:51.984215 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a2d62-0dd4-425a-a85d-9ec046af9cee admin admin] PATH_INFO: `/v3/domains/default/users/7b109de6a86e43399a6192c2887dcf96/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:51.992580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a2d62-0dd4-425a-a85d-9ec046af9cee admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7b109de6a86e43399a6192c2887dcf96, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:51.994022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-955a2d62-0dd4-425a-a85d-9ec046af9cee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:13:51.994022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:13:51.994022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:13:51.997426 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a2d62-0dd4-425a-a85d-9ec046af9cee admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:52.038079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 16/30] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:52.061672 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149d506-5539-454a-9308-57dd0eccde5c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:52.071885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149d506-5539-454a-9308-57dd0eccde5c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:52.206915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d19c0c-f888-4032-84bf-72ad91bee21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:52.207596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d19c0c-f888-4032-84bf-72ad91bee21a admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:52.207882 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d19c0c-f888-4032-84bf-72ad91bee21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:52.208196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d19c0c-f888-4032-84bf-72ad91bee21a admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:52.208931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d19c0c-f888-4032-84bf-72ad91bee21a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:52.209954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-91d19c0c-f888-4032-84bf-72ad91bee21a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:13:52.209954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:13:52.209954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:13:52.211191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d19c0c-f888-4032-84bf-72ad91bee21a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:52.262191 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 15/31] 10.222.0.90 () {58 vars in 1382 bytes} [Wed Feb 16 09:13:51 2022] PUT /identity/v3/domains/default/users/7b109de6a86e43399a6192c2887dcf96/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:13:52.264047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b9739-fa88-4a99-bde1-a7444f5c1803 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:52.264342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b9739-fa88-4a99-bde1-a7444f5c1803 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:52.264891 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b9739-fa88-4a99-bde1-a7444f5c1803 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:52.271078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 16/32] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:13:52.281875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d1814-554b-42e8-9aa7-ab104d92eeca None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:52.282267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d1814-554b-42e8-9aa7-ab104d92eeca None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:52.283173 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d1814-554b-42e8-9aa7-ab104d92eeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:52.321291 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-285d1814-554b-42e8-9aa7-ab104d92eeca None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:52.322916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-285d1814-554b-42e8-9aa7-ab104d92eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:52.342219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 17/33] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:13:52.408993 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d1814-554b-42e8-9aa7-ab104d92eeca None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:52.426570 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d1814-554b-42e8-9aa7-ab104d92eeca None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:52.438086 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f10776-ed13-4f67-9089-41ba8c87aa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:52.439351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f10776-ed13-4f67-9089-41ba8c87aa14 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:52.439635 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f10776-ed13-4f67-9089-41ba8c87aa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:52.439912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f10776-ed13-4f67-9089-41ba8c87aa14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:52.440720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f10776-ed13-4f67-9089-41ba8c87aa14 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:52.441959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-a1f10776-ed13-4f67-9089-41ba8c87aa14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:13:52.441959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:13:52.441959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:13:52.442886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f10776-ed13-4f67-9089-41ba8c87aa14 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:52.463378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 17/34] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:13:52 2022] POST /identity/v3/projects => generated 301 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:13:52.477985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 18/35] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:13:52 2022] POST /identity/v3/roles => generated 225 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:13:52.565157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3947235-0cdf-4d97-8b15-1c400be56dbb None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:52.565465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3947235-0cdf-4d97-8b15-1c400be56dbb None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:52.565656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3947235-0cdf-4d97-8b15-1c400be56dbb None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:52.567576 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 18/36] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:13:52.574690 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa795-57bc-4477-89db-99b2c4c2e74f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:52.575002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa795-57bc-4477-89db-99b2c4c2e74f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:52.575257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaa795-57bc-4477-89db-99b2c4c2e74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:52.596765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-eeeaa795-57bc-4477-89db-99b2c4c2e74f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:52.598008 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-eeeaa795-57bc-4477-89db-99b2c4c2e74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:52.706499 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 19/37] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:13:52.742720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3947235-0cdf-4d97-8b15-1c400be56dbb None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:52.765377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3947235-0cdf-4d97-8b15-1c400be56dbb None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:52.773314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01caaf6-5c3b-4467-ae51-188a8c4675a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:52.774055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01caaf6-5c3b-4467-ae51-188a8c4675a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:52.774341 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01caaf6-5c3b-4467-ae51-188a8c4675a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:52.774622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01caaf6-5c3b-4467-ae51-188a8c4675a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:52.775388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01caaf6-5c3b-4467-ae51-188a8c4675a3 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:52.776756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-e01caaf6-5c3b-4467-ae51-188a8c4675a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:13:52.776756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:13:52.776756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:13:52.777687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01caaf6-5c3b-4467-ae51-188a8c4675a3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:52.797859 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 19/38] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:13:52 2022] POST /identity/v3/roles => generated 219 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:13:53.203330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce6bb8-437b-47d8-a230-ef7922e9937e None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:53.203889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce6bb8-437b-47d8-a230-ef7922e9937e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:53.203889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce6bb8-437b-47d8-a230-ef7922e9937e None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:53.205867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 20/39] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:13:53.211246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e45f2-0706-4762-9ed7-635cf4fc6102 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:53.211763 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e45f2-0706-4762-9ed7-635cf4fc6102 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:53.212263 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e45f2-0706-4762-9ed7-635cf4fc6102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:53.231347 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-617e45f2-0706-4762-9ed7-635cf4fc6102 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:53.233204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-617e45f2-0706-4762-9ed7-635cf4fc6102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:53.241951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 20/40] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:13:53.265455 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce6bb8-437b-47d8-a230-ef7922e9937e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:53.277388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce6bb8-437b-47d8-a230-ef7922e9937e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:53.281615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f426a-9c8a-4ec9-896c-ace08bba6e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:53.282363 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f426a-9c8a-4ec9-896c-ace08bba6e3d admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:53.282658 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f426a-9c8a-4ec9-896c-ace08bba6e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:53.282933 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f426a-9c8a-4ec9-896c-ace08bba6e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:53.283675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f426a-9c8a-4ec9-896c-ace08bba6e3d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:53.285335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f426a-9c8a-4ec9-896c-ace08bba6e3d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:53.300929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 21/41] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:13:53 2022] POST /identity/v3/roles => generated 223 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:13:53.685922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefc528-746d-41d6-866b-b4ccc30a435c None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:53.686332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefc528-746d-41d6-866b-b4ccc30a435c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:53.686609 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefc528-746d-41d6-866b-b4ccc30a435c None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:53.688969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 21/42] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:13:53.694726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa6210-5da2-44e2-be22-04e5616e43e9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:53.695020 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa6210-5da2-44e2-be22-04e5616e43e9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:53.695301 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa6210-5da2-44e2-be22-04e5616e43e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:53.714023 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c7aa6210-5da2-44e2-be22-04e5616e43e9 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:53.715221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c7aa6210-5da2-44e2-be22-04e5616e43e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:53.724016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 22/43] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:13:53.747985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefc528-746d-41d6-866b-b4ccc30a435c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:53.761314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefc528-746d-41d6-866b-b4ccc30a435c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:53.766371 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372955c-50ee-4af3-9458-4dd22233a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:53.767770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372955c-50ee-4af3-9458-4dd22233a3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:53.768076 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372955c-50ee-4af3-9458-4dd22233a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:53.768353 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372955c-50ee-4af3-9458-4dd22233a3e1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:53.769543 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372955c-50ee-4af3-9458-4dd22233a3e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:53.771384 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372955c-50ee-4af3-9458-4dd22233a3e1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:53.773387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 22/44] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:13:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:53.778791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa6210-5da2-44e2-be22-04e5616e43e9 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:53.788736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa6210-5da2-44e2-be22-04e5616e43e9 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:53.793164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12c584-cb7c-4dee-b79d-78d9ff754035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:53.793815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12c584-cb7c-4dee-b79d-78d9ff754035 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:53.794128 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12c584-cb7c-4dee-b79d-78d9ff754035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:53.794405 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12c584-cb7c-4dee-b79d-78d9ff754035 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:53.795123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12c584-cb7c-4dee-b79d-78d9ff754035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:53.796180 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-db12c584-cb7c-4dee-b79d-78d9ff754035 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:13:53.796180 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:13:53.796180 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:13:53.797410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12c584-cb7c-4dee-b79d-78d9ff754035 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:53.824436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 23/45] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:13:53 2022] POST /identity/v3/projects => generated 312 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:13:54.928061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1724a90-78cc-4b13-846c-336414b593cc None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:54.928587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1724a90-78cc-4b13-846c-336414b593cc None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:54.928698 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1724a90-78cc-4b13-846c-336414b593cc None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:54.930377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 23/46] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:13:54.935706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756950a-ee1c-4a81-8aec-b0e9255f4a37 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:54.936134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756950a-ee1c-4a81-8aec-b0e9255f4a37 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:54.936406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4756950a-ee1c-4a81-8aec-b0e9255f4a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:54.955508 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4756950a-ee1c-4a81-8aec-b0e9255f4a37 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:54.956746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4756950a-ee1c-4a81-8aec-b0e9255f4a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:55.014183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 24/47] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:13:55.038444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1724a90-78cc-4b13-846c-336414b593cc None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:55.050661 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1724a90-78cc-4b13-846c-336414b593cc None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:55.054803 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce39d4d-836c-4048-ae4f-3e55c3aab4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:55.055573 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce39d4d-836c-4048-ae4f-3e55c3aab4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:55.055855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce39d4d-836c-4048-ae4f-3e55c3aab4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:55.056162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce39d4d-836c-4048-ae4f-3e55c3aab4d4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:55.066838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce39d4d-836c-4048-ae4f-3e55c3aab4d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:13:55.073557 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-9ce39d4d-836c-4048-ae4f-3e55c3aab4d4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:13:55.074708 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 24/48] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:13:55.081059 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756950a-ee1c-4a81-8aec-b0e9255f4a37 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:55.089942 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4756950a-ee1c-4a81-8aec-b0e9255f4a37 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:55.094401 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c62134-ba79-4079-9fd3-d000616ced7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:55.095087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c62134-ba79-4079-9fd3-d000616ced7d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:55.095375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c62134-ba79-4079-9fd3-d000616ced7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:55.095655 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c62134-ba79-4079-9fd3-d000616ced7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:55.096449 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c62134-ba79-4079-9fd3-d000616ced7d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:13:55.096763 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c62134-ba79-4079-9fd3-d000616ced7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:55.098389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c62134-ba79-4079-9fd3-d000616ced7d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:55.106480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 25/49] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:55.112054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce39d4d-836c-4048-ae4f-3e55c3aab4d4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:55.122295 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce39d4d-836c-4048-ae4f-3e55c3aab4d4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:55.127370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c832c-a469-4b6b-8b7a-6b0cecb0610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:55.128234 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c832c-a469-4b6b-8b7a-6b0cecb0610e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:55.128520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c832c-a469-4b6b-8b7a-6b0cecb0610e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:55.128804 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c832c-a469-4b6b-8b7a-6b0cecb0610e admin admin] PATH_INFO: `/v3/users/7b109de6a86e43399a6192c2887dcf96` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:55.130005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c832c-a469-4b6b-8b7a-6b0cecb0610e admin admin] RBAC: Authorizing `identity:get_user(user_id=7b109de6a86e43399a6192c2887dcf96)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:55.131840 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c832c-a469-4b6b-8b7a-6b0cecb0610e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:55.133511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 25/50] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:13:55 2022] GET /identity/v3/users/7b109de6a86e43399a6192c2887dcf96 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:55.138537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c62134-ba79-4079-9fd3-d000616ced7d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:55.149431 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c62134-ba79-4079-9fd3-d000616ced7d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:55.153766 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6b156-c47e-41d2-8046-93760e880ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:55.154762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6b156-c47e-41d2-8046-93760e880ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:55.155044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6b156-c47e-41d2-8046-93760e880ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:55.155318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6b156-c47e-41d2-8046-93760e880ef5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:55.156521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6b156-c47e-41d2-8046-93760e880ef5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:55.158205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6b156-c47e-41d2-8046-93760e880ef5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:55.159737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 26/51] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:13:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:13:55.165496 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c832c-a469-4b6b-8b7a-6b0cecb0610e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:55.175308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c832c-a469-4b6b-8b7a-6b0cecb0610e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:55.179932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19031a7-d8eb-46e3-86b2-ee10e01fe6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:55.180519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19031a7-d8eb-46e3-86b2-ee10e01fe6fe admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:55.180802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19031a7-d8eb-46e3-86b2-ee10e01fe6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:55.181077 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19031a7-d8eb-46e3-86b2-ee10e01fe6fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:55.181888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19031a7-d8eb-46e3-86b2-ee10e01fe6fe admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.domain.id=default, user.id=7b109de6a86e43399a6192c2887dcf96) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:13:55.182195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19031a7-d8eb-46e3-86b2-ee10e01fe6fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:55.183191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-c19031a7-d8eb-46e3-86b2-ee10e01fe6fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:13:55.183191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:13:55.183191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:13:55.184377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19031a7-d8eb-46e3-86b2-ee10e01fe6fe admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:55.191896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 26/52] 10.222.0.90 () {56 vars in 1343 bytes} [Wed Feb 16 09:13:55 2022] GET /identity/v3/role_assignments?user.id=7b109de6a86e43399a6192c2887dcf96&scope.domain.id=default&role.id=0e45946c6336419abb2015d8916e31ca => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:13:56.150930 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eb319-9074-4f21-ad1a-fe7da8225622 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:56.151447 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eb319-9074-4f21-ad1a-fe7da8225622 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:56.151531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eb319-9074-4f21-ad1a-fe7da8225622 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:56.153283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 27/53] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:13:56.158491 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d1f52-527f-4cb9-8581-4e611f202cce None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:56.158924 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d1f52-527f-4cb9-8581-4e611f202cce None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:56.159054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d1f52-527f-4cb9-8581-4e611f202cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:56.177054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-f41d1f52-527f-4cb9-8581-4e611f202cce None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:56.178245 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f41d1f52-527f-4cb9-8581-4e611f202cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:56.185708 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 27/54] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:13:56.209353 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eb319-9074-4f21-ad1a-fe7da8225622 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:56.221586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eb319-9074-4f21-ad1a-fe7da8225622 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:56.225882 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095623f9-ec2a-4853-845b-865dacae117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:56.226640 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095623f9-ec2a-4853-845b-865dacae117b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:56.226958 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095623f9-ec2a-4853-845b-865dacae117b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:56.227258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095623f9-ec2a-4853-845b-865dacae117b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:56.228456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095623f9-ec2a-4853-845b-865dacae117b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:56.230170 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095623f9-ec2a-4853-845b-865dacae117b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:56.231697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 28/55] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:13:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:56.237377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d1f52-527f-4cb9-8581-4e611f202cce None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:56.246164 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d1f52-527f-4cb9-8581-4e611f202cce None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:56.250607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b53add-9da6-40eb-b740-1fe8afee8cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:56.253123 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b53add-9da6-40eb-b740-1fe8afee8cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:56.253418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b53add-9da6-40eb-b740-1fe8afee8cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:56.253704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b53add-9da6-40eb-b740-1fe8afee8cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:56.254418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b53add-9da6-40eb-b740-1fe8afee8cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:56.256399 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b53add-9da6-40eb-b740-1fe8afee8cb4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:56.284499 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 28/56] 10.222.0.90 () {60 vars in 1161 bytes} [Wed Feb 16 09:13:56 2022] POST /identity/v3/projects => generated 298 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:13:58.610829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a39ed-4919-4cb8-bac0-2e3edc235f71 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:58.611428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a39ed-4919-4cb8-bac0-2e3edc235f71 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:58.611428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a39ed-4919-4cb8-bac0-2e3edc235f71 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:58.613212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 29/57] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:13:58.619037 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6def77e-699f-4af5-ab16-a1b20d71936f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:58.619466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6def77e-699f-4af5-ab16-a1b20d71936f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:58.619602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6def77e-699f-4af5-ab16-a1b20d71936f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:58.638008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-e6def77e-699f-4af5-ab16-a1b20d71936f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:13:58.639290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e6def77e-699f-4af5-ab16-a1b20d71936f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:13:58.701891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 29/58] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:13:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:13:58.727462 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a39ed-4919-4cb8-bac0-2e3edc235f71 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:58.739939 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a39ed-4919-4cb8-bac0-2e3edc235f71 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:58.744183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e736d35-79ea-4c17-ab1e-a78215b82591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:58.744948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e736d35-79ea-4c17-ab1e-a78215b82591 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:58.745232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e736d35-79ea-4c17-ab1e-a78215b82591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:58.745508 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e736d35-79ea-4c17-ab1e-a78215b82591 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:58.746667 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e736d35-79ea-4c17-ab1e-a78215b82591 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:58.748428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e736d35-79ea-4c17-ab1e-a78215b82591 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:58.749971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 30/59] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:13:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:13:58.755964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6def77e-699f-4af5-ab16-a1b20d71936f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:13:58.765673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6def77e-699f-4af5-ab16-a1b20d71936f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:13:58.770364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee4fff-3e8f-447d-8593-8c9891b31299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:13:58.771054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee4fff-3e8f-447d-8593-8c9891b31299 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:13:58.771415 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee4fff-3e8f-447d-8593-8c9891b31299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:13:58.771694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee4fff-3e8f-447d-8593-8c9891b31299 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:13:58.772434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee4fff-3e8f-447d-8593-8c9891b31299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:13:58.773608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-f3ee4fff-3e8f-447d-8593-8c9891b31299 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:13:58.773608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:13:58.773608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:13:58.775067 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee4fff-3e8f-447d-8593-8c9891b31299 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:13:58.802123 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 30/60] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:13:58 2022] POST /identity/v3/users => generated 275 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:02.456691 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27e856-7439-40aa-9f2b-d4fa9f40c8e2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.457769 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27e856-7439-40aa-9f2b-d4fa9f40c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.458260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27e856-7439-40aa-9f2b-d4fa9f40c8e2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.460748 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 31/61] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:02.474739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56b366-2020-4391-a797-f7a5b2b2a469 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.475235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56b366-2020-4391-a797-f7a5b2b2a469 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.475307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56b366-2020-4391-a797-f7a5b2b2a469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.505199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-4a56b366-2020-4391-a797-f7a5b2b2a469 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:02.506662 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4a56b366-2020-4391-a797-f7a5b2b2a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:02.521231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 31/62] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:02.560831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d03d47-ff0d-4011-881b-386f5d20731e None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.561444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d03d47-ff0d-4011-881b-386f5d20731e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.561914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d03d47-ff0d-4011-881b-386f5d20731e None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.564381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 32/63] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:02.568044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56b366-2020-4391-a797-f7a5b2b2a469 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.573905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56b366-2020-4391-a797-f7a5b2b2a469 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.580873 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885eeee-60ba-4cf2-aee5-b0c30fa03ecf None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.581405 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885eeee-60ba-4cf2-aee5-b0c30fa03ecf None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.581989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885eeee-60ba-4cf2-aee5-b0c30fa03ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.589258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c46ce-f376-437f-83e5-db3e1d4c0690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.590481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c46ce-f376-437f-83e5-db3e1d4c0690 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.590481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c46ce-f376-437f-83e5-db3e1d4c0690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.590665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c46ce-f376-437f-83e5-db3e1d4c0690 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.602498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f885eeee-60ba-4cf2-aee5-b0c30fa03ecf None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:02.604003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f885eeee-60ba-4cf2-aee5-b0c30fa03ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:02.609237 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408c46ce-f376-437f-83e5-db3e1d4c0690 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:02.613102 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 33/64] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:02.624849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-408c46ce-f376-437f-83e5-db3e1d4c0690 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:02.626663 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 32/65] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:02.632464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885eeee-60ba-4cf2-aee5-b0c30fa03ecf None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.648072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885eeee-60ba-4cf2-aee5-b0c30fa03ecf None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.649923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c46ce-f376-437f-83e5-db3e1d4c0690 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.660841 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b063800-6bd5-4809-b9e3-726f7c87f4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.661440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c46ce-f376-437f-83e5-db3e1d4c0690 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.661546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b063800-6bd5-4809-b9e3-726f7c87f4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.661813 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b063800-6bd5-4809-b9e3-726f7c87f4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.662132 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b063800-6bd5-4809-b9e3-726f7c87f4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.663011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b063800-6bd5-4809-b9e3-726f7c87f4f8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:02.663406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b063800-6bd5-4809-b9e3-726f7c87f4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:02.665235 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b063800-6bd5-4809-b9e3-726f7c87f4f8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:02.680177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 34/66] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:02.682862 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718faf8-a597-400c-ab09-63e3d7441472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.683000 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b063800-6bd5-4809-b9e3-726f7c87f4f8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.683676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718faf8-a597-400c-ab09-63e3d7441472 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.683953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718faf8-a597-400c-ab09-63e3d7441472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.684270 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718faf8-a597-400c-ab09-63e3d7441472 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.695112 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b063800-6bd5-4809-b9e3-726f7c87f4f8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.699483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718faf8-a597-400c-ab09-63e3d7441472 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:02.700609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c81303-d5e7-41a1-b406-bd339816f602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.701460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81303-d5e7-41a1-b406-bd339816f602 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.701810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81303-d5e7-41a1-b406-bd339816f602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.702131 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c81303-d5e7-41a1-b406-bd339816f602 admin admin] PATH_INFO: `/v3/users/01ad08141b814f0891a90f77ff968374` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.707742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-d718faf8-a597-400c-ab09-63e3d7441472 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:14:02.709504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 33/67] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:02.715438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7b638-81ba-42b0-84a3-817d7ee87068 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.715894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7b638-81ba-42b0-84a3-817d7ee87068 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.716338 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7b638-81ba-42b0-84a3-817d7ee87068 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.718564 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 34/68] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:02.719507 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7b638-81ba-42b0-84a3-817d7ee87068 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.722934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c81303-d5e7-41a1-b406-bd339816f602 admin admin] RBAC: Authorizing `identity:get_user(user_id=01ad08141b814f0891a90f77ff968374)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:02.725519 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c81303-d5e7-41a1-b406-bd339816f602 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:02.727693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 35/69] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/users/01ad08141b814f0891a90f77ff968374 => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:02.733324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4439b-00da-4d35-8ca5-1fb911728ce7 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.735343 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4439b-00da-4d35-8ca5-1fb911728ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.735799 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4439b-00da-4d35-8ca5-1fb911728ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.739660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7b638-81ba-42b0-84a3-817d7ee87068 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.745946 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4051eab-ddf0-4a68-a655-79177d14c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.746976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4051eab-ddf0-4a68-a655-79177d14c234 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.747523 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4051eab-ddf0-4a68-a655-79177d14c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.747993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4051eab-ddf0-4a68-a655-79177d14c234 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.749104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4051eab-ddf0-4a68-a655-79177d14c234 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:02.749674 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4051eab-ddf0-4a68-a655-79177d14c234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:02.751893 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4051eab-ddf0-4a68-a655-79177d14c234 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:02.756152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-aea4439b-00da-4d35-8ca5-1fb911728ce7 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:02.757363 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-aea4439b-00da-4d35-8ca5-1fb911728ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:02.763721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 35/70] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:02.765370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4051eab-ddf0-4a68-a655-79177d14c234 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.771378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 36/71] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:02.772271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4439b-00da-4d35-8ca5-1fb911728ce7 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.777902 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4051eab-ddf0-4a68-a655-79177d14c234 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.781620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4439b-00da-4d35-8ca5-1fb911728ce7 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.783921 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f5498-3028-49f9-8cce-1b4c9d9b557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.784884 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f5498-3028-49f9-8cce-1b4c9d9b557a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.785445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f5498-3028-49f9-8cce-1b4c9d9b557a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.786022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f5498-3028-49f9-8cce-1b4c9d9b557a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.787193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939e0af-6438-468d-a29a-da95042cb7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.788232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939e0af-6438-468d-a29a-da95042cb7ca admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.788657 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939e0af-6438-468d-a29a-da95042cb7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.789095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939e0af-6438-468d-a29a-da95042cb7ca admin admin] PATH_INFO: `/v3/users/7b109de6a86e43399a6192c2887dcf96` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.790434 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939e0af-6438-468d-a29a-da95042cb7ca admin admin] RBAC: Authorizing `identity:get_user(user_id=7b109de6a86e43399a6192c2887dcf96)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:02.792436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939e0af-6438-468d-a29a-da95042cb7ca admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:02.794447 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 37/72] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/users/7b109de6a86e43399a6192c2887dcf96 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:02.799302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f5498-3028-49f9-8cce-1b4c9d9b557a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:02.799302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f5498-3028-49f9-8cce-1b4c9d9b557a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:02.800470 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939e0af-6438-468d-a29a-da95042cb7ca admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.810168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939e0af-6438-468d-a29a-da95042cb7ca admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.813922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 36/73] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:02.815419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f5498-3028-49f9-8cce-1b4c9d9b557a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.816203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a40f4-0f6f-4ecf-92a7-f015ce8035be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.817240 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a40f4-0f6f-4ecf-92a7-f015ce8035be admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.817697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a40f4-0f6f-4ecf-92a7-f015ce8035be admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.818144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a40f4-0f6f-4ecf-92a7-f015ce8035be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.825566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f5498-3028-49f9-8cce-1b4c9d9b557a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.826921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a40f4-0f6f-4ecf-92a7-f015ce8035be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:02.829660 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a40f4-0f6f-4ecf-92a7-f015ce8035be admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:02.831313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f8ca3-f04e-4072-860b-2e3188cc63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.832394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f8ca3-f04e-4072-860b-2e3188cc63e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.832872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f8ca3-f04e-4072-860b-2e3188cc63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.833319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f8ca3-f04e-4072-860b-2e3188cc63e3 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.834880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f8ca3-f04e-4072-860b-2e3188cc63e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:02.837544 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f8ca3-f04e-4072-860b-2e3188cc63e3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:02.839674 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 38/74] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:02.844724 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 37/75] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:02.845521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a40f4-0f6f-4ecf-92a7-f015ce8035be admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.846299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f8ca3-f04e-4072-860b-2e3188cc63e3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.855106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a40f4-0f6f-4ecf-92a7-f015ce8035be admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.858208 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f8ca3-f04e-4072-860b-2e3188cc63e3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.860188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe2610-1522-413f-bde6-2196d609b073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.861198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe2610-1522-413f-bde6-2196d609b073 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.861672 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe2610-1522-413f-bde6-2196d609b073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.862050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe2610-1522-413f-bde6-2196d609b073 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.864340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837fc26-e99b-4455-be3e-81e521bed5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.865357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837fc26-e99b-4455-be3e-81e521bed5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.865813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837fc26-e99b-4455-be3e-81e521bed5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.866295 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837fc26-e99b-4455-be3e-81e521bed5e1 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.867735 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837fc26-e99b-4455-be3e-81e521bed5e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:02.870282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837fc26-e99b-4455-be3e-81e521bed5e1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:02.872712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 38/76] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:02.873820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837fc26-e99b-4455-be3e-81e521bed5e1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.879365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe2610-1522-413f-bde6-2196d609b073 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:02.885838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837fc26-e99b-4455-be3e-81e521bed5e1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.886842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-7cfe2610-1522-413f-bde6-2196d609b073 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:02.888431 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 39/77] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:02.889298 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe2610-1522-413f-bde6-2196d609b073 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.892720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498af2a0-40d8-4ac9-8057-43efe596c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.893776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498af2a0-40d8-4ac9-8057-43efe596c094 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.894403 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498af2a0-40d8-4ac9-8057-43efe596c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.895008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498af2a0-40d8-4ac9-8057-43efe596c094 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.896138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498af2a0-40d8-4ac9-8057-43efe596c094 admin admin] RBAC: Adding query filter params (role.id=4184b38195d04c3a88c76c1255f7c7f7, scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, user.id=01ad08141b814f0891a90f77ff968374) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:02.896694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498af2a0-40d8-4ac9-8057-43efe596c094 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:02.899004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498af2a0-40d8-4ac9-8057-43efe596c094 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:02.901833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe2610-1522-413f-bde6-2196d609b073 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.906100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 39/78] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/role_assignments?user.id=01ad08141b814f0891a90f77ff968374&scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba&role.id=4184b38195d04c3a88c76c1255f7c7f7 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:02.906210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3764487-ead7-41a9-8122-317cca7ab73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.906866 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764487-ead7-41a9-8122-317cca7ab73a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.907308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764487-ead7-41a9-8122-317cca7ab73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.907779 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3764487-ead7-41a9-8122-317cca7ab73a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.908156 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498af2a0-40d8-4ac9-8057-43efe596c094 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.908647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3764487-ead7-41a9-8122-317cca7ab73a admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, user.id=7b109de6a86e43399a6192c2887dcf96) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:02.908963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3764487-ead7-41a9-8122-317cca7ab73a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:02.910833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3764487-ead7-41a9-8122-317cca7ab73a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:02.917563 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 40/79] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/role_assignments?user.id=7b109de6a86e43399a6192c2887dcf96&scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba&role.id=0e45946c6336419abb2015d8916e31ca => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:02.918976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494af15-da21-4e50-804c-210dd374fd04 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.919267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494af15-da21-4e50-804c-210dd374fd04 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.919547 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494af15-da21-4e50-804c-210dd374fd04 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.921208 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498af2a0-40d8-4ac9-8057-43efe596c094 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:02.926776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d5e8a-db52-4ede-a461-3c348adedac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:02.927907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d5e8a-db52-4ede-a461-3c348adedac6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.928488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d5e8a-db52-4ede-a461-3c348adedac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.928956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d5e8a-db52-4ede-a461-3c348adedac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.929999 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 41/80] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:02 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:02.930311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d5e8a-db52-4ede-a461-3c348adedac6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:02.930899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d5e8a-db52-4ede-a461-3c348adedac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:02.933094 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d5e8a-db52-4ede-a461-3c348adedac6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:02.934247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a485f0-3b56-4054-8d95-11e105a371a1 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.934541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a485f0-3b56-4054-8d95-11e105a371a1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.934827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a485f0-3b56-4054-8d95-11e105a371a1 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.936671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 42/81] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:02.937941 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcd5f9-2867-4c88-a2f7-35e1a80a0cf6 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.938806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcd5f9-2867-4c88-a2f7-35e1a80a0cf6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.939131 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcd5f9-2867-4c88-a2f7-35e1a80a0cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.946521 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 40/82] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:02.948614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277512f-955d-44de-835a-0c8c439c4a3e None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:02.949200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277512f-955d-44de-835a-0c8c439c4a3e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:02.949763 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277512f-955d-44de-835a-0c8c439c4a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:02.960374 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c2dcd5f9-2867-4c88-a2f7-35e1a80a0cf6 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:02.961734 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c2dcd5f9-2867-4c88-a2f7-35e1a80a0cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:02.975859 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-2277512f-955d-44de-835a-0c8c439c4a3e None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:02.976696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 43/83] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:02.978210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2277512f-955d-44de-835a-0c8c439c4a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:02.978338 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcd5f9-2867-4c88-a2f7-35e1a80a0cf6 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:02.988959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 41/84] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:03.003815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcd5f9-2867-4c88-a2f7-35e1a80a0cf6 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:03.006131 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277512f-955d-44de-835a-0c8c439c4a3e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:03.017527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277512f-955d-44de-835a-0c8c439c4a3e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:03.020805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffea486-1144-4019-8cf8-76aa203552ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:03.021710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffea486-1144-4019-8cf8-76aa203552ec admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:03.022002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffea486-1144-4019-8cf8-76aa203552ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:03.022276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffea486-1144-4019-8cf8-76aa203552ec admin admin] PATH_INFO: `/v3/users/01ad08141b814f0891a90f77ff968374` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:03.022873 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa8e6d-e70d-4224-8ebc-6190f4b52fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:03.023599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffea486-1144-4019-8cf8-76aa203552ec admin admin] RBAC: Authorizing `identity:get_user(user_id=01ad08141b814f0891a90f77ff968374)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:03.023934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa8e6d-e70d-4224-8ebc-6190f4b52fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:03.024345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa8e6d-e70d-4224-8ebc-6190f4b52fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:03.024782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa8e6d-e70d-4224-8ebc-6190f4b52fd4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:03.025903 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffea486-1144-4019-8cf8-76aa203552ec admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:03.026293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa8e6d-e70d-4224-8ebc-6190f4b52fd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:03.027695 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 44/85] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:02 2022] GET /identity/v3/users/01ad08141b814f0891a90f77ff968374 => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:03.028650 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa8e6d-e70d-4224-8ebc-6190f4b52fd4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:03.030744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 42/86] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:03.030954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffea486-1144-4019-8cf8-76aa203552ec admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:03.043021 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa8e6d-e70d-4224-8ebc-6190f4b52fd4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:03.045660 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffea486-1144-4019-8cf8-76aa203552ec admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:03.051038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3962d32-ef10-4b3d-bccf-61c19d9b5f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:03.051856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3962d32-ef10-4b3d-bccf-61c19d9b5f14 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:03.052173 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3962d32-ef10-4b3d-bccf-61c19d9b5f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:03.052456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3962d32-ef10-4b3d-bccf-61c19d9b5f14 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:03.061003 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa8e6d-e70d-4224-8ebc-6190f4b52fd4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:03.065710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3962d32-ef10-4b3d-bccf-61c19d9b5f14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:03.068490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1cdd3-0e79-4e85-b758-ad65325fbfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:03.069565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1cdd3-0e79-4e85-b758-ad65325fbfbc admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:03.070082 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1cdd3-0e79-4e85-b758-ad65325fbfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:03.070599 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1cdd3-0e79-4e85-b758-ad65325fbfbc admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:03.071665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1cdd3-0e79-4e85-b758-ad65325fbfbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:03.073307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-d3962d32-ef10-4b3d-bccf-61c19d9b5f14 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:03.074620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1cdd3-0e79-4e85-b758-ad65325fbfbc admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:03.074776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 45/87] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:03.075631 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3962d32-ef10-4b3d-bccf-61c19d9b5f14 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:03.093088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3962d32-ef10-4b3d-bccf-61c19d9b5f14 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:03.099209 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac004dce-9489-4def-908f-3a94bb70ef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:03.100381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac004dce-9489-4def-908f-3a94bb70ef53 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:03.100900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac004dce-9489-4def-908f-3a94bb70ef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:03.101379 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac004dce-9489-4def-908f-3a94bb70ef53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:03.101959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 43/88] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:14:03 2022] POST /identity/v3/users => generated 289 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:03.103395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1cdd3-0e79-4e85-b758-ad65325fbfbc admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:03.113291 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac004dce-9489-4def-908f-3a94bb70ef53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:03.116191 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac004dce-9489-4def-908f-3a94bb70ef53 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:03.116887 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1cdd3-0e79-4e85-b758-ad65325fbfbc admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:03.123824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588411f-15b4-4fd9-8a9c-d3e50de362eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:03.125050 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588411f-15b4-4fd9-8a9c-d3e50de362eb admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:03.125385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588411f-15b4-4fd9-8a9c-d3e50de362eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:03.126342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588411f-15b4-4fd9-8a9c-d3e50de362eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:03.127316 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588411f-15b4-4fd9-8a9c-d3e50de362eb admin admin] RBAC: Adding query filter params (name=member) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:03.127629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588411f-15b4-4fd9-8a9c-d3e50de362eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:03.129768 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588411f-15b4-4fd9-8a9c-d3e50de362eb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:03.130143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 46/89] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:03.135812 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac004dce-9489-4def-908f-3a94bb70ef53 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:03.142307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 44/90] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:03.149426 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588411f-15b4-4fd9-8a9c-d3e50de362eb admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:03.151188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac004dce-9489-4def-908f-3a94bb70ef53 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:03.157261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60298388-48b7-409c-8fe2-482c10620f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:03.159305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60298388-48b7-409c-8fe2-482c10620f3b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:03.159926 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60298388-48b7-409c-8fe2-482c10620f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:03.160520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60298388-48b7-409c-8fe2-482c10620f3b admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:03.162039 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60298388-48b7-409c-8fe2-482c10620f3b admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:03.163082 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588411f-15b4-4fd9-8a9c-d3e50de362eb admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:03.164857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60298388-48b7-409c-8fe2-482c10620f3b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:03.166872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 47/91] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:03 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:03.171795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45deb7a-31c8-4572-bbcc-b202de578a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:03.171795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45deb7a-31c8-4572-bbcc-b202de578a6f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:03.171795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45deb7a-31c8-4572-bbcc-b202de578a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:03.171795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45deb7a-31c8-4572-bbcc-b202de578a6f admin admin] PATH_INFO: `/v3/users/01ad08141b814f0891a90f77ff968374` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:03.172260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45deb7a-31c8-4572-bbcc-b202de578a6f admin admin] RBAC: Authorizing `identity:get_user(user_id=01ad08141b814f0891a90f77ff968374)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:03.174572 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60298388-48b7-409c-8fe2-482c10620f3b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:03.176059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45deb7a-31c8-4572-bbcc-b202de578a6f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:03.178102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 45/92] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:03 2022] GET /identity/v3/users/01ad08141b814f0891a90f77ff968374 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:03.184783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45deb7a-31c8-4572-bbcc-b202de578a6f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:03.198195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45deb7a-31c8-4572-bbcc-b202de578a6f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:03.198653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60298388-48b7-409c-8fe2-482c10620f3b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:03.202960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671f785-5e2f-4873-beea-c46868306f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:03.203929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f785-5e2f-4873-beea-c46868306f06 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:03.203929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f785-5e2f-4873-beea-c46868306f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:03.204379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f785-5e2f-4873-beea-c46868306f06 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:03.208511 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0910f3c-34f1-447a-9bd8-85b847f647ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:03.209715 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0910f3c-34f1-447a-9bd8-85b847f647ad admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:03.210230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0910f3c-34f1-447a-9bd8-85b847f647ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:03.211414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0910f3c-34f1-447a-9bd8-85b847f647ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:03.213746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0910f3c-34f1-447a-9bd8-85b847f647ad admin admin] RBAC: Adding query filter params (role.id=34d194b1309f45d9a8ad70d08ccb4230, scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, user.id=01ad08141b814f0891a90f77ff968374) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:03.214431 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0910f3c-34f1-447a-9bd8-85b847f647ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:03.214880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671f785-5e2f-4873-beea-c46868306f06 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:03.216961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671f785-5e2f-4873-beea-c46868306f06 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:03.217981 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0910f3c-34f1-447a-9bd8-85b847f647ad admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:03.225601 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 48/93] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:03 2022] GET /identity/v3/role_assignments?user.id=01ad08141b814f0891a90f77ff968374&scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba&role.id=34d194b1309f45d9a8ad70d08ccb4230 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:03.228201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 46/94] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 09:14:03.234658 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0910f3c-34f1-447a-9bd8-85b847f647ad admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:03.248915 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0910f3c-34f1-447a-9bd8-85b847f647ad admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:03.257002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d0153-f93e-496c-8069-5b6dc4025df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:03.257904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0153-f93e-496c-8069-5b6dc4025df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:03.258190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0153-f93e-496c-8069-5b6dc4025df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:03.258472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d0153-f93e-496c-8069-5b6dc4025df0 admin admin] PATH_INFO: `/v3/projects/2e798321f2dc4e7490ad345ff8a29a11` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:03.265422 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d0153-f93e-496c-8069-5b6dc4025df0 admin admin] RBAC: Authorizing `identity:get_project(project_id=2e798321f2dc4e7490ad345ff8a29a11)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:03.268618 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d0153-f93e-496c-8069-5b6dc4025df0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:03.271335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 49/95] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:03 2022] GET /identity/v3/projects/2e798321f2dc4e7490ad345ff8a29a11 => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:03.277973 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671f785-5e2f-4873-beea-c46868306f06 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:03.294041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671f785-5e2f-4873-beea-c46868306f06 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:03.304698 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f28925-f648-4349-8366-421083088660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:03.305481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f28925-f648-4349-8366-421083088660 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:03.305997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f28925-f648-4349-8366-421083088660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:03.306351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f28925-f648-4349-8366-421083088660 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:03.307374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f28925-f648-4349-8366-421083088660 admin admin] RBAC: Adding query filter params (role.id=4184b38195d04c3a88c76c1255f7c7f7, scope.project.id=2e798321f2dc4e7490ad345ff8a29a11, user.id=01ad08141b814f0891a90f77ff968374) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:03.307733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f28925-f648-4349-8366-421083088660 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:03.309975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f28925-f648-4349-8366-421083088660 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:03.321086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 47/96] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:03 2022] GET /identity/v3/role_assignments?user.id=01ad08141b814f0891a90f77ff968374&scope.project.id=2e798321f2dc4e7490ad345ff8a29a11&role.id=4184b38195d04c3a88c76c1255f7c7f7 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:05.693190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df93f3c-6e3e-4151-be31-d33baf340a91 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:05.693714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df93f3c-6e3e-4151-be31-d33baf340a91 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:05.693714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df93f3c-6e3e-4151-be31-d33baf340a91 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:05.695872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 50/97] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:05.701443 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db63c29-e3f3-467b-9e77-73fa6500643c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:05.701904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db63c29-e3f3-467b-9e77-73fa6500643c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:05.702076 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db63c29-e3f3-467b-9e77-73fa6500643c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:05.729043 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-2db63c29-e3f3-467b-9e77-73fa6500643c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:05.730232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2db63c29-e3f3-467b-9e77-73fa6500643c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:05.740224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 48/98] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:05.781123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df93f3c-6e3e-4151-be31-d33baf340a91 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:05.798229 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df93f3c-6e3e-4151-be31-d33baf340a91 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:05.805137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee888a9-ea94-4f95-bfeb-8d9ddf764d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:05.805928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee888a9-ea94-4f95-bfeb-8d9ddf764d5d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:05.806213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee888a9-ea94-4f95-bfeb-8d9ddf764d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:05.806492 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee888a9-ea94-4f95-bfeb-8d9ddf764d5d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:05.821044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee888a9-ea94-4f95-bfeb-8d9ddf764d5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:05.827824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-bee888a9-ea94-4f95-bfeb-8d9ddf764d5d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:14:05.829587 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 51/99] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:14:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:05.835459 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db63c29-e3f3-467b-9e77-73fa6500643c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:05.847405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db63c29-e3f3-467b-9e77-73fa6500643c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:05.853928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b0189-3982-4798-a187-7995438e2981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:05.854597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b0189-3982-4798-a187-7995438e2981 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:05.854878 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b0189-3982-4798-a187-7995438e2981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:05.855155 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b0189-3982-4798-a187-7995438e2981 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:05.855901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b0189-3982-4798-a187-7995438e2981 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:05.856231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b0189-3982-4798-a187-7995438e2981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:05.858013 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b0189-3982-4798-a187-7995438e2981 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:05.871370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 49/100] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:05.877751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee888a9-ea94-4f95-bfeb-8d9ddf764d5d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:05.893316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee888a9-ea94-4f95-bfeb-8d9ddf764d5d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:05.903606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50aeb6-4934-4ff6-bfac-32578fe46a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:05.904751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50aeb6-4934-4ff6-bfac-32578fe46a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:05.905250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50aeb6-4934-4ff6-bfac-32578fe46a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:05.905749 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50aeb6-4934-4ff6-bfac-32578fe46a1d admin admin] PATH_INFO: `/v3/users/7b109de6a86e43399a6192c2887dcf96` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:05.907387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50aeb6-4934-4ff6-bfac-32578fe46a1d admin admin] RBAC: Authorizing `identity:get_user(user_id=7b109de6a86e43399a6192c2887dcf96)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:05.909567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50aeb6-4934-4ff6-bfac-32578fe46a1d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:05.911707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 52/101] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:05 2022] GET /identity/v3/users/7b109de6a86e43399a6192c2887dcf96 => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:05.916990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b0189-3982-4798-a187-7995438e2981 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:05.933390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b0189-3982-4798-a187-7995438e2981 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:05.943468 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebda31-fd44-425d-9ece-944c4d96ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:05.944306 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebda31-fd44-425d-9ece-944c4d96ca6f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:05.944590 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebda31-fd44-425d-9ece-944c4d96ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:05.944869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebda31-fd44-425d-9ece-944c4d96ca6f admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:05.946149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebda31-fd44-425d-9ece-944c4d96ca6f admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:05.948303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebda31-fd44-425d-9ece-944c4d96ca6f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:05.951103 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 50/102] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:05 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:05.956567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50aeb6-4934-4ff6-bfac-32578fe46a1d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:05.974433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50aeb6-4934-4ff6-bfac-32578fe46a1d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:05.983605 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ca9cd-bc93-417c-b554-452197cc4ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:05.985078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ca9cd-bc93-417c-b554-452197cc4ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:05.985890 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ca9cd-bc93-417c-b554-452197cc4ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:05.986375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ca9cd-bc93-417c-b554-452197cc4ea1 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba/users/7b109de6a86e43399a6192c2887dcf96/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:05.988717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ca9cd-bc93-417c-b554-452197cc4ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, user_id=7b109de6a86e43399a6192c2887dcf96, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:05.991652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ca9cd-bc93-417c-b554-452197cc4ea1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:06.012007 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 53/103] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:05 2022] PUT /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba/users/7b109de6a86e43399a6192c2887dcf96/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:06.359713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c772e4-cc20-4398-8887-c242f201d587 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.360770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c772e4-cc20-4398-8887-c242f201d587 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.361293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c772e4-cc20-4398-8887-c242f201d587 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.363345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 51/104] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:06.369249 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020f4ca-e31a-41b9-95f5-0c42b59c45e1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.369542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020f4ca-e31a-41b9-95f5-0c42b59c45e1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.369826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020f4ca-e31a-41b9-95f5-0c42b59c45e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.396339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3020f4ca-e31a-41b9-95f5-0c42b59c45e1 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:06.397559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3020f4ca-e31a-41b9-95f5-0c42b59c45e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:06.474496 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 54/105] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:06.510754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c772e4-cc20-4398-8887-c242f201d587 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:06.523524 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ed8ea-90a4-4264-94d7-882843dfc47f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.524087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ed8ea-90a4-4264-94d7-882843dfc47f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.524548 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ed8ea-90a4-4264-94d7-882843dfc47f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.526703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 55/106] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:06.528440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c772e4-cc20-4398-8887-c242f201d587 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:06.532765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07598151-bad1-4e5b-9d00-a9f6f12e608b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.533243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07598151-bad1-4e5b-9d00-a9f6f12e608b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.533685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07598151-bad1-4e5b-9d00-a9f6f12e608b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.534343 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724bf0f-10d4-48d2-8359-7ed7adc9b025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:06.535361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724bf0f-10d4-48d2-8359-7ed7adc9b025 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.535848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724bf0f-10d4-48d2-8359-7ed7adc9b025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.536357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724bf0f-10d4-48d2-8359-7ed7adc9b025 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.560017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-07598151-bad1-4e5b-9d00-a9f6f12e608b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:06.561456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-07598151-bad1-4e5b-9d00-a9f6f12e608b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:06.568744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724bf0f-10d4-48d2-8359-7ed7adc9b025 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:06.576113 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-8724bf0f-10d4-48d2-8359-7ed7adc9b025 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:06.577635 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 52/107] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:06.584425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724bf0f-10d4-48d2-8359-7ed7adc9b025 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:06.586048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 56/108] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:06.600425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724bf0f-10d4-48d2-8359-7ed7adc9b025 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:06.607398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35dce2-46f1-4674-b4e1-404abe3b52e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:06.608177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35dce2-46f1-4674-b4e1-404abe3b52e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.608462 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35dce2-46f1-4674-b4e1-404abe3b52e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.608732 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35dce2-46f1-4674-b4e1-404abe3b52e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.609527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35dce2-46f1-4674-b4e1-404abe3b52e0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:06.610381 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35dce2-46f1-4674-b4e1-404abe3b52e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:06.612277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35dce2-46f1-4674-b4e1-404abe3b52e0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:06.620948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07598151-bad1-4e5b-9d00-a9f6f12e608b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:06.628527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 53/109] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:06.634002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35dce2-46f1-4674-b4e1-404abe3b52e0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:06.635122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07598151-bad1-4e5b-9d00-a9f6f12e608b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:06.640106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c95592-3373-4dae-959a-c595bfb34ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:06.641834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c95592-3373-4dae-959a-c595bfb34ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.642414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c95592-3373-4dae-959a-c595bfb34ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.642893 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c95592-3373-4dae-959a-c595bfb34ef1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.647857 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35dce2-46f1-4674-b4e1-404abe3b52e0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:06.661006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f9895-6a86-4e0b-8047-d66326f6903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:06.662406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f9895-6a86-4e0b-8047-d66326f6903d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.663567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c95592-3373-4dae-959a-c595bfb34ef1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:06.663922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f9895-6a86-4e0b-8047-d66326f6903d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.664412 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f9895-6a86-4e0b-8047-d66326f6903d admin admin] PATH_INFO: `/v3/users/01ad08141b814f0891a90f77ff968374` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.668911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f9895-6a86-4e0b-8047-d66326f6903d admin admin] RBAC: Authorizing `identity:get_user(user_id=01ad08141b814f0891a90f77ff968374)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:06.672380 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f9895-6a86-4e0b-8047-d66326f6903d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:06.674558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 54/110] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:06 2022] GET /identity/v3/users/01ad08141b814f0891a90f77ff968374 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:06.678328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-f4c95592-3373-4dae-959a-c595bfb34ef1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:06.679766 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 57/111] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:06.680892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f9895-6a86-4e0b-8047-d66326f6903d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:06.686440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c95592-3373-4dae-959a-c595bfb34ef1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:06.698025 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f9895-6a86-4e0b-8047-d66326f6903d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:06.704702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c95592-3373-4dae-959a-c595bfb34ef1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:06.707549 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5b751-92d0-4402-ade4-606bb1940fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:06.709818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5b751-92d0-4402-ade4-606bb1940fba admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.710714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5b751-92d0-4402-ade4-606bb1940fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.711572 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5b751-92d0-4402-ade4-606bb1940fba admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.714074 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5b751-92d0-4402-ade4-606bb1940fba admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:06.717639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be67550-e26d-4d99-87bf-672c32a82447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:06.719001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5b751-92d0-4402-ade4-606bb1940fba admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:06.720337 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be67550-e26d-4d99-87bf-672c32a82447 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.720817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be67550-e26d-4d99-87bf-672c32a82447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.721342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be67550-e26d-4d99-87bf-672c32a82447 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.722402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be67550-e26d-4d99-87bf-672c32a82447 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:06.722916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be67550-e26d-4d99-87bf-672c32a82447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:06.724902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be67550-e26d-4d99-87bf-672c32a82447 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:06.726256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 55/112] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:06 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:06.731841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5b751-92d0-4402-ade4-606bb1940fba admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:06.744792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 58/113] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:06.745646 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5b751-92d0-4402-ade4-606bb1940fba admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:06.750292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be67550-e26d-4d99-87bf-672c32a82447 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:06.761683 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df8a98-044f-442b-a0c3-9bbe7a68553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:06.762591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df8a98-044f-442b-a0c3-9bbe7a68553d admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.762879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df8a98-044f-442b-a0c3-9bbe7a68553d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.763161 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df8a98-044f-442b-a0c3-9bbe7a68553d admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba/users/01ad08141b814f0891a90f77ff968374/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.765458 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df8a98-044f-442b-a0c3-9bbe7a68553d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, user_id=01ad08141b814f0891a90f77ff968374, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:06.766065 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be67550-e26d-4d99-87bf-672c32a82447 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:06.767289 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-f2df8a98-044f-442b-a0c3-9bbe7a68553d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:06.767289 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:14:06.767289 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:14:06.772063 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df8a98-044f-442b-a0c3-9bbe7a68553d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:06.785276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebde99-8a8d-4d14-b9bc-175c9f0aae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:06.786848 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebde99-8a8d-4d14-b9bc-175c9f0aae1b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.787592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebde99-8a8d-4d14-b9bc-175c9f0aae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.788178 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebde99-8a8d-4d14-b9bc-175c9f0aae1b admin admin] PATH_INFO: `/v3/users/01ad08141b814f0891a90f77ff968374` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.789954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebde99-8a8d-4d14-b9bc-175c9f0aae1b admin admin] RBAC: Authorizing `identity:get_user(user_id=01ad08141b814f0891a90f77ff968374)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:06.792466 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebde99-8a8d-4d14-b9bc-175c9f0aae1b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:06.801081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 59/114] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:06 2022] GET /identity/v3/users/01ad08141b814f0891a90f77ff968374 => generated 275 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:06.801638 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 56/115] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:06 2022] PUT /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba/users/01ad08141b814f0891a90f77ff968374/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:14:06.806384 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebde99-8a8d-4d14-b9bc-175c9f0aae1b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:06.821670 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebde99-8a8d-4d14-b9bc-175c9f0aae1b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:06.895285 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf9383-e9ca-4385-b4f2-0c49a0c5a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:06.896544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf9383-e9ca-4385-b4f2-0c49a0c5a4aa admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.897025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf9383-e9ca-4385-b4f2-0c49a0c5a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.897591 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf9383-e9ca-4385-b4f2-0c49a0c5a4aa admin admin] PATH_INFO: `/v3/projects/2e798321f2dc4e7490ad345ff8a29a11` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.898986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf9383-e9ca-4385-b4f2-0c49a0c5a4aa admin admin] RBAC: Authorizing `identity:get_project(project_id=2e798321f2dc4e7490ad345ff8a29a11)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:06.901440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf9383-e9ca-4385-b4f2-0c49a0c5a4aa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:06.903337 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 60/116] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:06 2022] GET /identity/v3/projects/2e798321f2dc4e7490ad345ff8a29a11 => generated 312 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:06.909444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df8a98-044f-442b-a0c3-9bbe7a68553d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:06.920493 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee1138-cbe9-40c6-947b-d821c4541335 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.921104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee1138-cbe9-40c6-947b-d821c4541335 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.921608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee1138-cbe9-40c6-947b-d821c4541335 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.923756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 61/117] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:06.929057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac539a-7121-4d5b-9eb6-c717b35cc172 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.929560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac539a-7121-4d5b-9eb6-c717b35cc172 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.930049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac539a-7121-4d5b-9eb6-c717b35cc172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.934064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df8a98-044f-442b-a0c3-9bbe7a68553d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:06.949640 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ef39f-122c-4e8c-98cd-06051de0d1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:06.950548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ef39f-122c-4e8c-98cd-06051de0d1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:06.950832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ef39f-122c-4e8c-98cd-06051de0d1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:06.951109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ef39f-122c-4e8c-98cd-06051de0d1e2 admin admin] PATH_INFO: `/v3/projects/2e798321f2dc4e7490ad345ff8a29a11/users/01ad08141b814f0891a90f77ff968374/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:06.951928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-98ac539a-7121-4d5b-9eb6-c717b35cc172 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:06.953120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ef39f-122c-4e8c-98cd-06051de0d1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e798321f2dc4e7490ad345ff8a29a11, user_id=01ad08141b814f0891a90f77ff968374, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:06.953860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-98ac539a-7121-4d5b-9eb6-c717b35cc172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:06.956447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ef39f-122c-4e8c-98cd-06051de0d1e2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:06.974178 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 62/118] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:06.991479 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 57/119] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:06 2022] PUT /identity/v3/projects/2e798321f2dc4e7490ad345ff8a29a11/users/01ad08141b814f0891a90f77ff968374/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:07.024335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac539a-7121-4d5b-9eb6-c717b35cc172 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.045041 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac539a-7121-4d5b-9eb6-c717b35cc172 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.115780 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8a18-8afb-4c60-baf0-b37c78d9557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.117050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8a18-8afb-4c60-baf0-b37c78d9557e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.117624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8a18-8afb-4c60-baf0-b37c78d9557e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.118098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8a18-8afb-4c60-baf0-b37c78d9557e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.132060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e8a18-8afb-4c60-baf0-b37c78d9557e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:07.140289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-6d8e8a18-8afb-4c60-baf0-b37c78d9557e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:07.141969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 63/120] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:07.148247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ef39f-122c-4e8c-98cd-06051de0d1e2 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.166570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ef39f-122c-4e8c-98cd-06051de0d1e2 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.178185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973f712-99a9-47d3-a22c-b03b0bf8912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.178886 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973f712-99a9-47d3-a22c-b03b0bf8912b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.179171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973f712-99a9-47d3-a22c-b03b0bf8912b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.179450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973f712-99a9-47d3-a22c-b03b0bf8912b admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.180256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973f712-99a9-47d3-a22c-b03b0bf8912b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:07.180566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973f712-99a9-47d3-a22c-b03b0bf8912b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:07.182247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973f712-99a9-47d3-a22c-b03b0bf8912b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:07.199889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 58/121] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:07.205527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8a18-8afb-4c60-baf0-b37c78d9557e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.219766 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8a18-8afb-4c60-baf0-b37c78d9557e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.225985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91021f-1d18-4bef-9147-7fea7d7fea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.227259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91021f-1d18-4bef-9147-7fea7d7fea3a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.227744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91021f-1d18-4bef-9147-7fea7d7fea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.228316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91021f-1d18-4bef-9147-7fea7d7fea3a admin admin] PATH_INFO: `/v3/users/01ad08141b814f0891a90f77ff968374` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.229894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91021f-1d18-4bef-9147-7fea7d7fea3a admin admin] RBAC: Authorizing `identity:get_user(user_id=01ad08141b814f0891a90f77ff968374)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:07.232428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91021f-1d18-4bef-9147-7fea7d7fea3a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:07.234456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 64/122] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:07 2022] GET /identity/v3/users/01ad08141b814f0891a90f77ff968374 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:07.240885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973f712-99a9-47d3-a22c-b03b0bf8912b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.252409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973f712-99a9-47d3-a22c-b03b0bf8912b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.257632 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a9cfd-c617-4fae-a985-9403f14b6588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.258923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a9cfd-c617-4fae-a985-9403f14b6588 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.259409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a9cfd-c617-4fae-a985-9403f14b6588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.259919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a9cfd-c617-4fae-a985-9403f14b6588 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.261518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a9cfd-c617-4fae-a985-9403f14b6588 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:07.269166 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a9cfd-c617-4fae-a985-9403f14b6588 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:07.271420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 59/123] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:07 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:07.277230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91021f-1d18-4bef-9147-7fea7d7fea3a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.288185 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91021f-1d18-4bef-9147-7fea7d7fea3a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.293193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd1f9d-3bb5-4691-9205-c94f6d8c71f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.294423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd1f9d-3bb5-4691-9205-c94f6d8c71f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.294940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd1f9d-3bb5-4691-9205-c94f6d8c71f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.295415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd1f9d-3bb5-4691-9205-c94f6d8c71f6 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba/users/01ad08141b814f0891a90f77ff968374/roles/34d194b1309f45d9a8ad70d08ccb4230` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.298632 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd1f9d-3bb5-4691-9205-c94f6d8c71f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, user_id=01ad08141b814f0891a90f77ff968374, role_id=34d194b1309f45d9a8ad70d08ccb4230)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:07.301944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd1f9d-3bb5-4691-9205-c94f6d8c71f6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:07.318944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 65/124] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:07 2022] PUT /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba/users/01ad08141b814f0891a90f77ff968374/roles/34d194b1309f45d9a8ad70d08ccb4230 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:07.456428 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9f3c3-ea18-42df-a601-aafd97d13029 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.456720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9f3c3-ea18-42df-a601-aafd97d13029 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.456909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9f3c3-ea18-42df-a601-aafd97d13029 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.457286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b78509-196b-4ac0-baa6-4b3f6c426c24 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.457784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b78509-196b-4ac0-baa6-4b3f6c426c24 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.458260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b78509-196b-4ac0-baa6-4b3f6c426c24 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.458711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 60/125] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:07.460616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 66/126] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:07.466022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11dff1-ca30-4336-b3ca-c9e2b398f5ab None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.466317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11dff1-ca30-4336-b3ca-c9e2b398f5ab None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.466586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11dff1-ca30-4336-b3ca-c9e2b398f5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.466979 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092c2a9-8628-4f8f-94ce-91f2246dd602 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.467472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092c2a9-8628-4f8f-94ce-91f2246dd602 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.467947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092c2a9-8628-4f8f-94ce-91f2246dd602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.493667 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4092c2a9-8628-4f8f-94ce-91f2246dd602 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:07.495322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4092c2a9-8628-4f8f-94ce-91f2246dd602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:07.497104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-5f11dff1-ca30-4336-b3ca-c9e2b398f5ab None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:07.499086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-5f11dff1-ca30-4336-b3ca-c9e2b398f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:07.577046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 67/127] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:07.598392 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 61/128] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:07.611025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092c2a9-8628-4f8f-94ce-91f2246dd602 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.620833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092c2a9-8628-4f8f-94ce-91f2246dd602 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.626574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73262fb3-fb7d-4cf6-aa90-8f68f38d0b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.627699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73262fb3-fb7d-4cf6-aa90-8f68f38d0b4d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.628226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73262fb3-fb7d-4cf6-aa90-8f68f38d0b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.628707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73262fb3-fb7d-4cf6-aa90-8f68f38d0b4d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.630130 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73262fb3-fb7d-4cf6-aa90-8f68f38d0b4d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:07.632227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73262fb3-fb7d-4cf6-aa90-8f68f38d0b4d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:07.634077 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 68/129] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:07.642634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11dff1-ca30-4336-b3ca-c9e2b398f5ab None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.644259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73262fb3-fb7d-4cf6-aa90-8f68f38d0b4d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.659652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73262fb3-fb7d-4cf6-aa90-8f68f38d0b4d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.662285 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11dff1-ca30-4336-b3ca-c9e2b398f5ab None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.664991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd2940-901e-4be8-b9e5-14ce5ebb14b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.666036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd2940-901e-4be8-b9e5-14ce5ebb14b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.666544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd2940-901e-4be8-b9e5-14ce5ebb14b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.667023 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd2940-901e-4be8-b9e5-14ce5ebb14b6 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.679724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd2940-901e-4be8-b9e5-14ce5ebb14b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:07.684736 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150e12a-5cdd-486f-9f38-39ac1e02a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.685423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150e12a-5cdd-486f-9f38-39ac1e02a720 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.685714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150e12a-5cdd-486f-9f38-39ac1e02a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.685993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150e12a-5cdd-486f-9f38-39ac1e02a720 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.686711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150e12a-5cdd-486f-9f38-39ac1e02a720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:07.689132 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-d0bd2940-901e-4be8-b9e5-14ce5ebb14b6 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 09:14:07.689357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150e12a-5cdd-486f-9f38-39ac1e02a720 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:07.690861 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 69/130] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:07.696471 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd2940-901e-4be8-b9e5-14ce5ebb14b6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.708175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd2940-901e-4be8-b9e5-14ce5ebb14b6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.713678 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20afea-25bc-453b-8291-210ac477cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.714731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20afea-25bc-453b-8291-210ac477cdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.715311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20afea-25bc-453b-8291-210ac477cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.715793 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20afea-25bc-453b-8291-210ac477cdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.716864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20afea-25bc-453b-8291-210ac477cdd4 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:07.717367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20afea-25bc-453b-8291-210ac477cdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:07.719627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20afea-25bc-453b-8291-210ac477cdd4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:07.735593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 70/131] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:07.736686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 62/132] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:14:07 2022] POST /identity/v3/projects => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:07.740809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20afea-25bc-453b-8291-210ac477cdd4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.752427 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20afea-25bc-453b-8291-210ac477cdd4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.816878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdc534-7508-4ab2-808a-a3b49005f2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.818134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdc534-7508-4ab2-808a-a3b49005f2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.818621 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdc534-7508-4ab2-808a-a3b49005f2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.819116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdc534-7508-4ab2-808a-a3b49005f2b1 admin admin] PATH_INFO: `/v3/users/ba70f1333e4340c89c526f3c38e5c61a` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.834054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdc534-7508-4ab2-808a-a3b49005f2b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=ba70f1333e4340c89c526f3c38e5c61a)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:07.836730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdc534-7508-4ab2-808a-a3b49005f2b1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:07.838770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 71/133] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:07 2022] GET /identity/v3/users/ba70f1333e4340c89c526f3c38e5c61a => generated 289 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:07.844952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150e12a-5cdd-486f-9f38-39ac1e02a720 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.861956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150e12a-5cdd-486f-9f38-39ac1e02a720 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.867230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b2225-65d8-4036-a74b-170155436787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.868328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b2225-65d8-4036-a74b-170155436787 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.868807 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b2225-65d8-4036-a74b-170155436787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.869307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b2225-65d8-4036-a74b-170155436787 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.884135 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b2225-65d8-4036-a74b-170155436787 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:07.885965 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b2225-65d8-4036-a74b-170155436787 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:07.902105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 63/134] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:07.908857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdc534-7508-4ab2-808a-a3b49005f2b1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.919874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdc534-7508-4ab2-808a-a3b49005f2b1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.932142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626573e1-e674-4a5d-9df2-d440f98082f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.933489 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626573e1-e674-4a5d-9df2-d440f98082f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.934003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626573e1-e674-4a5d-9df2-d440f98082f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.934470 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626573e1-e674-4a5d-9df2-d440f98082f7 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.936095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626573e1-e674-4a5d-9df2-d440f98082f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:07.939483 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626573e1-e674-4a5d-9df2-d440f98082f7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:07.941676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 72/135] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:07 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:07.948151 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b2225-65d8-4036-a74b-170155436787 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:07.961692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b2225-65d8-4036-a74b-170155436787 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:07.976855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926103f1-12ba-4389-97bb-ad9fa9533d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:07.977600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926103f1-12ba-4389-97bb-ad9fa9533d07 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:07.977891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926103f1-12ba-4389-97bb-ad9fa9533d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:07.978169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926103f1-12ba-4389-97bb-ad9fa9533d07 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:07.979007 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926103f1-12ba-4389-97bb-ad9fa9533d07 admin admin] RBAC: Adding query filter params (role.id=da2cc800c7ad48d3a58d60617c9ed38e, scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, user.id=ba70f1333e4340c89c526f3c38e5c61a) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:07.979319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926103f1-12ba-4389-97bb-ad9fa9533d07 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:07.981221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926103f1-12ba-4389-97bb-ad9fa9533d07 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:07.987974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 64/136] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:07 2022] GET /identity/v3/role_assignments?user.id=ba70f1333e4340c89c526f3c38e5c61a&scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba&role.id=da2cc800c7ad48d3a58d60617c9ed38e => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:09.794040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1ebba-342f-476d-b9e3-0f313da0a77f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:09.795053 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1ebba-342f-476d-b9e3-0f313da0a77f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:09.795563 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1ebba-342f-476d-b9e3-0f313da0a77f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:09.797952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 73/137] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:09.803012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4b563-f984-46b2-af8d-48741954c83c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:09.803422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4b563-f984-46b2-af8d-48741954c83c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:09.803591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4b563-f984-46b2-af8d-48741954c83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:09.829905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-4ec4b563-f984-46b2-af8d-48741954c83c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:09.831109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4ec4b563-f984-46b2-af8d-48741954c83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:09.840629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 65/138] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:09.876629 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1ebba-342f-476d-b9e3-0f313da0a77f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:09.894941 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1ebba-342f-476d-b9e3-0f313da0a77f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:09.899915 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d08356-449f-435c-a2e3-f99d23493045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:09.900952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08356-449f-435c-a2e3-f99d23493045 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:09.901433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08356-449f-435c-a2e3-f99d23493045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:09.901902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08356-449f-435c-a2e3-f99d23493045 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:09.917167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d08356-449f-435c-a2e3-f99d23493045 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:09.924482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-40d08356-449f-435c-a2e3-f99d23493045 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:14:09.925923 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 74/139] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:14:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:09.931879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4b563-f984-46b2-af8d-48741954c83c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:09.941763 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4b563-f984-46b2-af8d-48741954c83c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:09.952201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2c6a9-bcbc-44d7-90cf-20aed1ff5bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:09.952885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c6a9-bcbc-44d7-90cf-20aed1ff5bae admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:09.953171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c6a9-bcbc-44d7-90cf-20aed1ff5bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:09.954011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c6a9-bcbc-44d7-90cf-20aed1ff5bae admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:09.954875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2c6a9-bcbc-44d7-90cf-20aed1ff5bae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:09.955185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2c6a9-bcbc-44d7-90cf-20aed1ff5bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:09.956863 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2c6a9-bcbc-44d7-90cf-20aed1ff5bae admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:09.970055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 66/140] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:09.975781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d08356-449f-435c-a2e3-f99d23493045 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:09.992052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d08356-449f-435c-a2e3-f99d23493045 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:09.998976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cda18e-a7b7-4248-a37e-238260d956bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.000135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cda18e-a7b7-4248-a37e-238260d956bf admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.001221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cda18e-a7b7-4248-a37e-238260d956bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.001694 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cda18e-a7b7-4248-a37e-238260d956bf admin admin] PATH_INFO: `/v3/users/7b109de6a86e43399a6192c2887dcf96` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.003190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cda18e-a7b7-4248-a37e-238260d956bf admin admin] RBAC: Authorizing `identity:get_user(user_id=7b109de6a86e43399a6192c2887dcf96)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.005403 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cda18e-a7b7-4248-a37e-238260d956bf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.007223 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 75/141] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:09 2022] GET /identity/v3/users/7b109de6a86e43399a6192c2887dcf96 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:10.013257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2c6a9-bcbc-44d7-90cf-20aed1ff5bae admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.025689 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2c6a9-bcbc-44d7-90cf-20aed1ff5bae admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.037178 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63c3b0-9632-482d-b686-019f63f5e747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.037852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c3b0-9632-482d-b686-019f63f5e747 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.038138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c3b0-9632-482d-b686-019f63f5e747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.038417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63c3b0-9632-482d-b686-019f63f5e747 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.052917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63c3b0-9632-482d-b686-019f63f5e747 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.054643 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63c3b0-9632-482d-b686-019f63f5e747 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.068641 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 67/142] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:10.074770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cda18e-a7b7-4248-a37e-238260d956bf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.085922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cda18e-a7b7-4248-a37e-238260d956bf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.096570 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2d2f3-7d7c-48c9-90c5-aa2c65fcb429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.105475 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2d2f3-7d7c-48c9-90c5-aa2c65fcb429 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.106123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2d2f3-7d7c-48c9-90c5-aa2c65fcb429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.106713 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2d2f3-7d7c-48c9-90c5-aa2c65fcb429 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.112801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2d2f3-7d7c-48c9-90c5-aa2c65fcb429 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.115329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2d2f3-7d7c-48c9-90c5-aa2c65fcb429 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.117849 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 76/143] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:10.124330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63c3b0-9632-482d-b686-019f63f5e747 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.137154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63c3b0-9632-482d-b686-019f63f5e747 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.149203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ece1a-ec10-48aa-8a31-cc779bdd1f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.149880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ece1a-ec10-48aa-8a31-cc779bdd1f65 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.150169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ece1a-ec10-48aa-8a31-cc779bdd1f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.150527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ece1a-ec10-48aa-8a31-cc779bdd1f65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.151711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ece1a-ec10-48aa-8a31-cc779bdd1f65 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, user.id=7b109de6a86e43399a6192c2887dcf96) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:10.152210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ece1a-ec10-48aa-8a31-cc779bdd1f65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.155071 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ece1a-ec10-48aa-8a31-cc779bdd1f65 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.166347 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 68/144] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/role_assignments?user.id=7b109de6a86e43399a6192c2887dcf96&scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba&role.id=0e45946c6336419abb2015d8916e31ca => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:10.508458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee04eb-f521-46ed-857f-1004903aafd9 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.509137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee04eb-f521-46ed-857f-1004903aafd9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.509616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee04eb-f521-46ed-857f-1004903aafd9 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.511661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 77/145] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:10.518140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9c36d-c540-494d-812b-b9ab59c9189a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.518675 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9c36d-c540-494d-812b-b9ab59c9189a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.519147 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9c36d-c540-494d-812b-b9ab59c9189a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.540629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-aeb9c36d-c540-494d-812b-b9ab59c9189a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:10.542138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-aeb9c36d-c540-494d-812b-b9ab59c9189a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:10.553896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 69/146] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:10.580453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee04eb-f521-46ed-857f-1004903aafd9 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.593119 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee04eb-f521-46ed-857f-1004903aafd9 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.603601 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de09c96-f4ad-43df-b22c-272bf55ed71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.604700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de09c96-f4ad-43df-b22c-272bf55ed71d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.605182 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de09c96-f4ad-43df-b22c-272bf55ed71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.605649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de09c96-f4ad-43df-b22c-272bf55ed71d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.617746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de09c96-f4ad-43df-b22c-272bf55ed71d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:10.622936 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cec641-fda1-456e-829a-45a7af5cc9cd None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.623221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cec641-fda1-456e-829a-45a7af5cc9cd None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.623497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cec641-fda1-456e-829a-45a7af5cc9cd None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.626550 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-6de09c96-f4ad-43df-b22c-272bf55ed71d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:10.627221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 70/147] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:10.628214 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 78/148] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:10.631856 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f916f6e-23fd-4f0b-b684-5445c404ddf4 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.632182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f916f6e-23fd-4f0b-b684-5445c404ddf4 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.632463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f916f6e-23fd-4f0b-b684-5445c404ddf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.643269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de09c96-f4ad-43df-b22c-272bf55ed71d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.653901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de09c96-f4ad-43df-b22c-272bf55ed71d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.659555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d659615-39d0-49dd-8238-f61fa8c49728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.660446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659615-39d0-49dd-8238-f61fa8c49728 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.660886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659615-39d0-49dd-8238-f61fa8c49728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.661047 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-6f916f6e-23fd-4f0b-b684-5445c404ddf4 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:10.661440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659615-39d0-49dd-8238-f61fa8c49728 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.662237 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6f916f6e-23fd-4f0b-b684-5445c404ddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:10.662499 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659615-39d0-49dd-8238-f61fa8c49728 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:10.662954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659615-39d0-49dd-8238-f61fa8c49728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.664762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659615-39d0-49dd-8238-f61fa8c49728 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.674444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 79/149] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:10.678904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 71/150] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:10.680016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d659615-39d0-49dd-8238-f61fa8c49728 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.690574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d659615-39d0-49dd-8238-f61fa8c49728 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.699797 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb8103-3ab0-4108-9e5f-6c083e9b416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.700915 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb8103-3ab0-4108-9e5f-6c083e9b416b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.701470 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb8103-3ab0-4108-9e5f-6c083e9b416b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.701918 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb8103-3ab0-4108-9e5f-6c083e9b416b admin admin] PATH_INFO: `/v3/users/01ad08141b814f0891a90f77ff968374` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.707229 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb8103-3ab0-4108-9e5f-6c083e9b416b admin admin] RBAC: Authorizing `identity:get_user(user_id=01ad08141b814f0891a90f77ff968374)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.707410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f916f6e-23fd-4f0b-b684-5445c404ddf4 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.709981 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb8103-3ab0-4108-9e5f-6c083e9b416b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.711958 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 80/151] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/users/01ad08141b814f0891a90f77ff968374 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:10.718104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb8103-3ab0-4108-9e5f-6c083e9b416b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.724131 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f916f6e-23fd-4f0b-b684-5445c404ddf4 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.728353 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb8103-3ab0-4108-9e5f-6c083e9b416b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.737417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bd43d-5d46-41c5-8798-f990ad9fcc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.738265 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bd43d-5d46-41c5-8798-f990ad9fcc82 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.738544 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bd43d-5d46-41c5-8798-f990ad9fcc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.738826 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bd43d-5d46-41c5-8798-f990ad9fcc82 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.756685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668b52f-1d69-4292-b05b-a3a985ede0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.757339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b52f-1d69-4292-b05b-a3a985ede0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.757615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b52f-1d69-4292-b05b-a3a985ede0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.757883 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668b52f-1d69-4292-b05b-a3a985ede0b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.767539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668b52f-1d69-4292-b05b-a3a985ede0b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.769267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668b52f-1d69-4292-b05b-a3a985ede0b0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.776673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bd43d-5d46-41c5-8798-f990ad9fcc82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:10.780566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 81/152] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 09:14:10.786928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668b52f-1d69-4292-b05b-a3a985ede0b0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.787158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-a48bd43d-5d46-41c5-8798-f990ad9fcc82 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:10.788730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 72/153] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:10.796045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668b52f-1d69-4292-b05b-a3a985ede0b0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.797273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bd43d-5d46-41c5-8798-f990ad9fcc82 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.800943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3668d-64dc-4f9c-b265-2b9f17837301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.801783 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3668d-64dc-4f9c-b265-2b9f17837301 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.802060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3668d-64dc-4f9c-b265-2b9f17837301 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.802328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3668d-64dc-4f9c-b265-2b9f17837301 admin admin] PATH_INFO: `/v3/projects/2e798321f2dc4e7490ad345ff8a29a11` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.803510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3668d-64dc-4f9c-b265-2b9f17837301 admin admin] RBAC: Authorizing `identity:get_project(project_id=2e798321f2dc4e7490ad345ff8a29a11)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.805629 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3668d-64dc-4f9c-b265-2b9f17837301 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.807579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 82/154] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/projects/2e798321f2dc4e7490ad345ff8a29a11 => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:10.814312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3668d-64dc-4f9c-b265-2b9f17837301 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.818427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bd43d-5d46-41c5-8798-f990ad9fcc82 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.823901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3668d-64dc-4f9c-b265-2b9f17837301 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.830264 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f7dd0-dae7-4d9e-9c8e-db3b84bbd56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.830928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f7dd0-dae7-4d9e-9c8e-db3b84bbd56f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.831231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f7dd0-dae7-4d9e-9c8e-db3b84bbd56f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.831508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f7dd0-dae7-4d9e-9c8e-db3b84bbd56f admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.832278 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f7dd0-dae7-4d9e-9c8e-db3b84bbd56f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:10.832583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f7dd0-dae7-4d9e-9c8e-db3b84bbd56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.834195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f7dd0-dae7-4d9e-9c8e-db3b84bbd56f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.836854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf796a-76fc-4d88-8e57-eb6f18b39568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.837526 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf796a-76fc-4d88-8e57-eb6f18b39568 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.837801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf796a-76fc-4d88-8e57-eb6f18b39568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.838121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf796a-76fc-4d88-8e57-eb6f18b39568 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.838945 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf796a-76fc-4d88-8e57-eb6f18b39568 admin admin] RBAC: Adding query filter params (role.id=4184b38195d04c3a88c76c1255f7c7f7, scope.project.id=2e798321f2dc4e7490ad345ff8a29a11, user.id=01ad08141b814f0891a90f77ff968374) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:10.839252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf796a-76fc-4d88-8e57-eb6f18b39568 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.841611 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf796a-76fc-4d88-8e57-eb6f18b39568 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.849153 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 83/155] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/role_assignments?user.id=01ad08141b814f0891a90f77ff968374&scope.project.id=2e798321f2dc4e7490ad345ff8a29a11&role.id=4184b38195d04c3a88c76c1255f7c7f7 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:10.854380 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 73/156] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:10.861028 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf796a-76fc-4d88-8e57-eb6f18b39568 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.861558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3b192-c458-47f0-803f-f72a985af536 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.861852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3b192-c458-47f0-803f-f72a985af536 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.862129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3b192-c458-47f0-803f-f72a985af536 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.863965 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 74/157] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:10.869591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d5882-25cf-4ac0-9e52-7e4c40c0a599 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.869884 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d5882-25cf-4ac0-9e52-7e4c40c0a599 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.870165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d5882-25cf-4ac0-9e52-7e4c40c0a599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.873757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf796a-76fc-4d88-8e57-eb6f18b39568 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.879234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e222d-3e27-4405-8f45-efbf7c5660a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.880158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e222d-3e27-4405-8f45-efbf7c5660a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.880464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e222d-3e27-4405-8f45-efbf7c5660a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.880761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e222d-3e27-4405-8f45-efbf7c5660a8 admin admin] PATH_INFO: `/v3/users/01ad08141b814f0891a90f77ff968374` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.882076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e222d-3e27-4405-8f45-efbf7c5660a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=01ad08141b814f0891a90f77ff968374)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.884320 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e222d-3e27-4405-8f45-efbf7c5660a8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.886435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 84/158] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/users/01ad08141b814f0891a90f77ff968374 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:10.893090 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e222d-3e27-4405-8f45-efbf7c5660a8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.912056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e222d-3e27-4405-8f45-efbf7c5660a8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.914169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-562d5882-25cf-4ac0-9e52-7e4c40c0a599 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:10.915363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-562d5882-25cf-4ac0-9e52-7e4c40c0a599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:10.923423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99820a14-a03d-4e40-a691-9236714d92be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.924257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99820a14-a03d-4e40-a691-9236714d92be admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.924492 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99820a14-a03d-4e40-a691-9236714d92be admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.924766 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99820a14-a03d-4e40-a691-9236714d92be admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.934631 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 75/159] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:10.939443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99820a14-a03d-4e40-a691-9236714d92be admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.941386 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99820a14-a03d-4e40-a691-9236714d92be admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.950584 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 85/160] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:10.957393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d5882-25cf-4ac0-9e52-7e4c40c0a599 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.967092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d5882-25cf-4ac0-9e52-7e4c40c0a599 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.972679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf6e2a-3240-488f-a94c-8968757299aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:10.973543 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf6e2a-3240-488f-a94c-8968757299aa admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:10.973820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf6e2a-3240-488f-a94c-8968757299aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:10.974093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf6e2a-3240-488f-a94c-8968757299aa admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:10.975329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf6e2a-3240-488f-a94c-8968757299aa admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:10.977533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf6e2a-3240-488f-a94c-8968757299aa admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:10.979289 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 76/161] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:10.985174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99820a14-a03d-4e40-a691-9236714d92be admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.989075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf6e2a-3240-488f-a94c-8968757299aa admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:10.995073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99820a14-a03d-4e40-a691-9236714d92be admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:10.999833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a270a9-24d6-4fce-ad78-3fa88b992d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:11.000803 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a270a9-24d6-4fce-ad78-3fa88b992d56 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.001084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a270a9-24d6-4fce-ad78-3fa88b992d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.002036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a270a9-24d6-4fce-ad78-3fa88b992d56 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.010654 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf6e2a-3240-488f-a94c-8968757299aa admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:11.020524 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a270a9-24d6-4fce-ad78-3fa88b992d56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:11.027798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-38a270a9-24d6-4fce-ad78-3fa88b992d56 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:11.029336 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 86/162] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:11.033184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fabed9-2f6b-4f39-9b34-cc14c261ca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:11.034040 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fabed9-2f6b-4f39-9b34-cc14c261ca32 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.034307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fabed9-2f6b-4f39-9b34-cc14c261ca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.034599 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fabed9-2f6b-4f39-9b34-cc14c261ca32 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.035446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fabed9-2f6b-4f39-9b34-cc14c261ca32 admin admin] RBAC: Adding query filter params (role.id=34d194b1309f45d9a8ad70d08ccb4230, scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, user.id=01ad08141b814f0891a90f77ff968374) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:11.035761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fabed9-2f6b-4f39-9b34-cc14c261ca32 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:11.037824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fabed9-2f6b-4f39-9b34-cc14c261ca32 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:11.039091 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a270a9-24d6-4fce-ad78-3fa88b992d56 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:11.051964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a270a9-24d6-4fce-ad78-3fa88b992d56 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:11.055417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 77/163] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:10 2022] GET /identity/v3/role_assignments?user.id=01ad08141b814f0891a90f77ff968374&scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba&role.id=34d194b1309f45d9a8ad70d08ccb4230 => generated 608 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:11.056794 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e237de-9c69-42bc-9d16-1d267de6a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:11.057461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e237de-9c69-42bc-9d16-1d267de6a19e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.057740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e237de-9c69-42bc-9d16-1d267de6a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.058008 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e237de-9c69-42bc-9d16-1d267de6a19e admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.058761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e237de-9c69-42bc-9d16-1d267de6a19e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:11.059062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e237de-9c69-42bc-9d16-1d267de6a19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:11.060784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e237de-9c69-42bc-9d16-1d267de6a19e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:11.071125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 87/164] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:11.076938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fabed9-2f6b-4f39-9b34-cc14c261ca32 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:11.090170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fabed9-2f6b-4f39-9b34-cc14c261ca32 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:11.098049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858fbbe-0e14-429e-a7e9-7063b55792d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:11.098950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858fbbe-0e14-429e-a7e9-7063b55792d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.099231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858fbbe-0e14-429e-a7e9-7063b55792d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.099504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858fbbe-0e14-429e-a7e9-7063b55792d0 admin admin] PATH_INFO: `/v3/users/01ad08141b814f0891a90f77ff968374` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.100869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858fbbe-0e14-429e-a7e9-7063b55792d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=01ad08141b814f0891a90f77ff968374)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:11.103085 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858fbbe-0e14-429e-a7e9-7063b55792d0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:11.104896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 78/165] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:11 2022] GET /identity/v3/users/01ad08141b814f0891a90f77ff968374 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:11.111436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e237de-9c69-42bc-9d16-1d267de6a19e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:11.121847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e237de-9c69-42bc-9d16-1d267de6a19e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:11.127393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfe489-acb8-4102-987a-dbb4069c83ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:11.128084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfe489-acb8-4102-987a-dbb4069c83ed admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.128424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfe489-acb8-4102-987a-dbb4069c83ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.128701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfe489-acb8-4102-987a-dbb4069c83ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.138037 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfe489-acb8-4102-987a-dbb4069c83ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:11.140278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfe489-acb8-4102-987a-dbb4069c83ed admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:11.151238 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 88/166] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:11.157820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858fbbe-0e14-429e-a7e9-7063b55792d0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:11.168446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858fbbe-0e14-429e-a7e9-7063b55792d0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:11.171394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335edf29-86c1-4f6e-a5ef-aeaa10fdbfea None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.171731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335edf29-86c1-4f6e-a5ef-aeaa10fdbfea None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.171971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335edf29-86c1-4f6e-a5ef-aeaa10fdbfea None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.174706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 89/167] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:11.176262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e311e1-3708-4e75-841b-895e7a633be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:11.177212 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e311e1-3708-4e75-841b-895e7a633be6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.177562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e311e1-3708-4e75-841b-895e7a633be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.177900 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e311e1-3708-4e75-841b-895e7a633be6 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.179286 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e311e1-3708-4e75-841b-895e7a633be6 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:11.180772 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046101-7b38-4209-bd1a-2ccace92e7d4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.181125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046101-7b38-4209-bd1a-2ccace92e7d4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.181468 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046101-7b38-4209-bd1a-2ccace92e7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.183541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e311e1-3708-4e75-841b-895e7a633be6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:11.185467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 79/168] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:11 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:11.193314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e311e1-3708-4e75-841b-895e7a633be6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:11.214079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-26046101-7b38-4209-bd1a-2ccace92e7d4 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:11.215167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e311e1-3708-4e75-841b-895e7a633be6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:11.215278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-26046101-7b38-4209-bd1a-2ccace92e7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:11.221442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fe0df-df1c-4c2c-9f20-158f5ff26fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:11.222464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fe0df-df1c-4c2c-9f20-158f5ff26fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.222950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fe0df-df1c-4c2c-9f20-158f5ff26fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.223424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fe0df-df1c-4c2c-9f20-158f5ff26fc5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.224636 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fe0df-df1c-4c2c-9f20-158f5ff26fc5 admin admin] RBAC: Adding query filter params (role.id=4184b38195d04c3a88c76c1255f7c7f7, scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, user.id=01ad08141b814f0891a90f77ff968374) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:11.225159 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fe0df-df1c-4c2c-9f20-158f5ff26fc5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:11.225847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 90/169] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:11.227582 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fe0df-df1c-4c2c-9f20-158f5ff26fc5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:11.234655 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 80/170] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:11 2022] GET /identity/v3/role_assignments?user.id=01ad08141b814f0891a90f77ff968374&scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba&role.id=4184b38195d04c3a88c76c1255f7c7f7 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:11.249728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26046101-7b38-4209-bd1a-2ccace92e7d4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:11.260315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26046101-7b38-4209-bd1a-2ccace92e7d4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:11.265514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4006469-3b51-4bcd-8552-b83f39ee357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:11.267054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4006469-3b51-4bcd-8552-b83f39ee357f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.267332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4006469-3b51-4bcd-8552-b83f39ee357f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.267605 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4006469-3b51-4bcd-8552-b83f39ee357f admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.281118 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4006469-3b51-4bcd-8552-b83f39ee357f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:11.288573 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-c4006469-3b51-4bcd-8552-b83f39ee357f admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 09:14:11.290292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 91/171] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:11.296220 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fe0df-df1c-4c2c-9f20-158f5ff26fc5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:11.307576 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fe0df-df1c-4c2c-9f20-158f5ff26fc5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:11.317346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cd061-f246-4e9e-91cf-8d2ea0e083ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:11.318081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cd061-f246-4e9e-91cf-8d2ea0e083ed admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.318413 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cd061-f246-4e9e-91cf-8d2ea0e083ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.318689 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cd061-f246-4e9e-91cf-8d2ea0e083ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.319517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cd061-f246-4e9e-91cf-8d2ea0e083ed admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:11.319867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cd061-f246-4e9e-91cf-8d2ea0e083ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:11.321656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cd061-f246-4e9e-91cf-8d2ea0e083ed admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:11.333549 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 81/172] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:11.339298 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4006469-3b51-4bcd-8552-b83f39ee357f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:11.350097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4006469-3b51-4bcd-8552-b83f39ee357f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:11.355169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19078d7-4d1b-4da4-894f-6dd1d1a9bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:11.356159 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19078d7-4d1b-4da4-894f-6dd1d1a9bee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.356442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19078d7-4d1b-4da4-894f-6dd1d1a9bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.356715 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19078d7-4d1b-4da4-894f-6dd1d1a9bee3 admin admin] PATH_INFO: `/v3/users/ba70f1333e4340c89c526f3c38e5c61a` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.358064 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19078d7-4d1b-4da4-894f-6dd1d1a9bee3 admin admin] RBAC: Authorizing `identity:get_user(user_id=ba70f1333e4340c89c526f3c38e5c61a)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:11.360410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19078d7-4d1b-4da4-894f-6dd1d1a9bee3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:11.362256 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 92/173] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:11 2022] GET /identity/v3/users/ba70f1333e4340c89c526f3c38e5c61a => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:11.367786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cd061-f246-4e9e-91cf-8d2ea0e083ed admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:11.378741 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cd061-f246-4e9e-91cf-8d2ea0e083ed admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:11.383477 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e3d04-7bb0-4521-a6c3-4717be6c9914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:11.384362 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3d04-7bb0-4521-a6c3-4717be6c9914 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.384642 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3d04-7bb0-4521-a6c3-4717be6c9914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.384922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3d04-7bb0-4521-a6c3-4717be6c9914 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.386184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e3d04-7bb0-4521-a6c3-4717be6c9914 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:11.392806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e3d04-7bb0-4521-a6c3-4717be6c9914 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:11.394934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 82/174] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:11 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:11.400873 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19078d7-4d1b-4da4-894f-6dd1d1a9bee3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:11.412086 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19078d7-4d1b-4da4-894f-6dd1d1a9bee3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:11.419837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3085e-dd0e-408a-92c5-c5245284c313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:11.420809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3085e-dd0e-408a-92c5-c5245284c313 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.421115 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3085e-dd0e-408a-92c5-c5245284c313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.421387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3085e-dd0e-408a-92c5-c5245284c313 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba/users/ba70f1333e4340c89c526f3c38e5c61a/roles/da2cc800c7ad48d3a58d60617c9ed38e` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.423563 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3085e-dd0e-408a-92c5-c5245284c313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, user_id=ba70f1333e4340c89c526f3c38e5c61a, role_id=da2cc800c7ad48d3a58d60617c9ed38e)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:11.427378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3085e-dd0e-408a-92c5-c5245284c313 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:11.443218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 93/175] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:11 2022] PUT /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba/users/ba70f1333e4340c89c526f3c38e5c61a/roles/da2cc800c7ad48d3a58d60617c9ed38e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:11.931112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfd22c-c4af-472a-ab0c-0d2dcbb9a138 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.931639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfd22c-c4af-472a-ab0c-0d2dcbb9a138 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.931639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfd22c-c4af-472a-ab0c-0d2dcbb9a138 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.933435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 83/176] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:11.939086 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bf5e9-26ea-42c8-80b0-47b443316e02 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:11.939530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bf5e9-26ea-42c8-80b0-47b443316e02 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:11.939649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bf5e9-26ea-42c8-80b0-47b443316e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:11.957031 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-245bf5e9-26ea-42c8-80b0-47b443316e02 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:11.958200 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-245bf5e9-26ea-42c8-80b0-47b443316e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:12.014962 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 94/177] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:12.040767 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfd22c-c4af-472a-ab0c-0d2dcbb9a138 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:12.053692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfd22c-c4af-472a-ab0c-0d2dcbb9a138 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:12.058048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c209b0-7f02-40ff-b847-a5a35174f8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:12.058895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c209b0-7f02-40ff-b847-a5a35174f8cb admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:12.059269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c209b0-7f02-40ff-b847-a5a35174f8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:12.059546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c209b0-7f02-40ff-b847-a5a35174f8cb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:12.060747 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c209b0-7f02-40ff-b847-a5a35174f8cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:12.062502 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c209b0-7f02-40ff-b847-a5a35174f8cb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:12.064365 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 84/178] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:12.069755 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bf5e9-26ea-42c8-80b0-47b443316e02 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:12.078999 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bf5e9-26ea-42c8-80b0-47b443316e02 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:12.083563 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60156ff9-202f-4257-8686-7561681f3ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:12.084244 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156ff9-202f-4257-8686-7561681f3ddb admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:12.084531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156ff9-202f-4257-8686-7561681f3ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:12.084846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60156ff9-202f-4257-8686-7561681f3ddb admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:12.085560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60156ff9-202f-4257-8686-7561681f3ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:12.086685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-60156ff9-202f-4257-8686-7561681f3ddb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:12.086685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:14:12.086685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:14:12.088015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60156ff9-202f-4257-8686-7561681f3ddb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:12.116098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 95/179] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:14:12 2022] POST /identity/v3/users => generated 283 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:13.891407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fdc7d-e08d-42df-8469-a3db17a145f4 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:13.891930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fdc7d-e08d-42df-8469-a3db17a145f4 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:13.891930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fdc7d-e08d-42df-8469-a3db17a145f4 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:13.894350 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 85/180] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:13.900009 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1795e9-e02a-4687-a264-64a6cd1ec61d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:13.900431 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1795e9-e02a-4687-a264-64a6cd1ec61d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:13.900653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1795e9-e02a-4687-a264-64a6cd1ec61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:13.921000 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6d1795e9-e02a-4687-a264-64a6cd1ec61d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:13.923014 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6d1795e9-e02a-4687-a264-64a6cd1ec61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:13.931736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 96/181] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:13.956753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fdc7d-e08d-42df-8469-a3db17a145f4 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:13.969708 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fdc7d-e08d-42df-8469-a3db17a145f4 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:13.974433 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b2bfd-f718-4d2a-a74b-91a7f39e0138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:13.975459 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b2bfd-f718-4d2a-a74b-91a7f39e0138 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:13.975930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b2bfd-f718-4d2a-a74b-91a7f39e0138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:13.976426 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b2bfd-f718-4d2a-a74b-91a7f39e0138 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:13.988416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b2bfd-f718-4d2a-a74b-91a7f39e0138 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:13.995659 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-0b2b2bfd-f718-4d2a-a74b-91a7f39e0138 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 09:14:13.997127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 86/182] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:14.004046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1795e9-e02a-4687-a264-64a6cd1ec61d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.015082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1795e9-e02a-4687-a264-64a6cd1ec61d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.020223 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df47b8-2b13-405c-bd8c-68d1070f6604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.020880 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df47b8-2b13-405c-bd8c-68d1070f6604 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.021157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df47b8-2b13-405c-bd8c-68d1070f6604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.021430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df47b8-2b13-405c-bd8c-68d1070f6604 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.022172 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df47b8-2b13-405c-bd8c-68d1070f6604 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:14.022476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df47b8-2b13-405c-bd8c-68d1070f6604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.024095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df47b8-2b13-405c-bd8c-68d1070f6604 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.038266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 97/183] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:14.043957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b2bfd-f718-4d2a-a74b-91a7f39e0138 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.053963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b2bfd-f718-4d2a-a74b-91a7f39e0138 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.058406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb011fe-1481-4e2d-8f5b-4fa84be07f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.059257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb011fe-1481-4e2d-8f5b-4fa84be07f40 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.059529 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb011fe-1481-4e2d-8f5b-4fa84be07f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.059794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb011fe-1481-4e2d-8f5b-4fa84be07f40 admin admin] PATH_INFO: `/v3/users/ba70f1333e4340c89c526f3c38e5c61a` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.061078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb011fe-1481-4e2d-8f5b-4fa84be07f40 admin admin] RBAC: Authorizing `identity:get_user(user_id=ba70f1333e4340c89c526f3c38e5c61a)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.064062 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb011fe-1481-4e2d-8f5b-4fa84be07f40 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.065934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 87/184] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/users/ba70f1333e4340c89c526f3c38e5c61a => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:14.071125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df47b8-2b13-405c-bd8c-68d1070f6604 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.081592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df47b8-2b13-405c-bd8c-68d1070f6604 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.085946 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7511-a32f-4b89-ae96-98f2dd0dc567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.086625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7511-a32f-4b89-ae96-98f2dd0dc567 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.086908 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7511-a32f-4b89-ae96-98f2dd0dc567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.087178 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b7511-a32f-4b89-ae96-98f2dd0dc567 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.095609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b7511-a32f-4b89-ae96-98f2dd0dc567 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.097407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b7511-a32f-4b89-ae96-98f2dd0dc567 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.106592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 98/185] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:14.112246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb011fe-1481-4e2d-8f5b-4fa84be07f40 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.121904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb011fe-1481-4e2d-8f5b-4fa84be07f40 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.127117 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cab1db-4245-4468-89e9-04a0d23b4325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.127961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cab1db-4245-4468-89e9-04a0d23b4325 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.128276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cab1db-4245-4468-89e9-04a0d23b4325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.128547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cab1db-4245-4468-89e9-04a0d23b4325 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.129719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cab1db-4245-4468-89e9-04a0d23b4325 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.131764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cab1db-4245-4468-89e9-04a0d23b4325 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.133662 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 88/186] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:14.139238 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7511-a32f-4b89-ae96-98f2dd0dc567 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.149245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b7511-a32f-4b89-ae96-98f2dd0dc567 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.153801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d80bfd-eb20-4a6c-95c6-07c9dca6c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.154437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d80bfd-eb20-4a6c-95c6-07c9dca6c960 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.154714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d80bfd-eb20-4a6c-95c6-07c9dca6c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.154986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d80bfd-eb20-4a6c-95c6-07c9dca6c960 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.155804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d80bfd-eb20-4a6c-95c6-07c9dca6c960 admin admin] RBAC: Adding query filter params (role.id=da2cc800c7ad48d3a58d60617c9ed38e, scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, user.id=ba70f1333e4340c89c526f3c38e5c61a) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:14.156137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d80bfd-eb20-4a6c-95c6-07c9dca6c960 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.158197 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d80bfd-eb20-4a6c-95c6-07c9dca6c960 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.164867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 99/187] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/role_assignments?user.id=ba70f1333e4340c89c526f3c38e5c61a&scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba&role.id=da2cc800c7ad48d3a58d60617c9ed38e => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:14.598553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7917e-8c4f-4b68-bfb9-dfd92a054bfd None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.598918 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7917e-8c4f-4b68-bfb9-dfd92a054bfd None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.599098 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7917e-8c4f-4b68-bfb9-dfd92a054bfd None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.601046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 89/188] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:14.606065 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f3e9-0772-4a08-8c77-48c05bebe5f3 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.606353 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f3e9-0772-4a08-8c77-48c05bebe5f3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.606628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580f3e9-0772-4a08-8c77-48c05bebe5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.624859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1580f3e9-0772-4a08-8c77-48c05bebe5f3 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:14.626707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1580f3e9-0772-4a08-8c77-48c05bebe5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:14.634447 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 100/189] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:14.658223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7917e-8c4f-4b68-bfb9-dfd92a054bfd None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.670354 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7917e-8c4f-4b68-bfb9-dfd92a054bfd None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.675378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d21fce-fccc-49ea-92ae-2dc7711c97bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.676210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d21fce-fccc-49ea-92ae-2dc7711c97bb admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.676487 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d21fce-fccc-49ea-92ae-2dc7711c97bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.676754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d21fce-fccc-49ea-92ae-2dc7711c97bb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.686869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d21fce-fccc-49ea-92ae-2dc7711c97bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:14.694437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-d5d21fce-fccc-49ea-92ae-2dc7711c97bb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:14:14.695793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 90/190] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:14.701339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580f3e9-0772-4a08-8c77-48c05bebe5f3 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.710462 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580f3e9-0772-4a08-8c77-48c05bebe5f3 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.714941 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6dc29-43ab-4eb7-b50f-ae1ffa7cafbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.715593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6dc29-43ab-4eb7-b50f-ae1ffa7cafbd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.715868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6dc29-43ab-4eb7-b50f-ae1ffa7cafbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.716169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6dc29-43ab-4eb7-b50f-ae1ffa7cafbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.716907 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6dc29-43ab-4eb7-b50f-ae1ffa7cafbd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:14.717205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6dc29-43ab-4eb7-b50f-ae1ffa7cafbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.718778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6dc29-43ab-4eb7-b50f-ae1ffa7cafbd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.727377 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 101/191] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:14.732715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d21fce-fccc-49ea-92ae-2dc7711c97bb admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.743024 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935e57-a317-4fa7-8e88-ac2236c27ff4 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.743314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935e57-a317-4fa7-8e88-ac2236c27ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.743583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2935e57-a317-4fa7-8e88-ac2236c27ff4 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.744861 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d21fce-fccc-49ea-92ae-2dc7711c97bb admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.745472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 102/192] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:14.751043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca141b-2db0-4e54-9566-ee95688d2cda None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.751330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca141b-2db0-4e54-9566-ee95688d2cda None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.751612 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca141b-2db0-4e54-9566-ee95688d2cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.752647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9753ebb-92f7-4d2a-88a9-8aa61da3e409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.753515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9753ebb-92f7-4d2a-88a9-8aa61da3e409 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.753828 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9753ebb-92f7-4d2a-88a9-8aa61da3e409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.754063 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9753ebb-92f7-4d2a-88a9-8aa61da3e409 admin admin] PATH_INFO: `/v3/users/912e3b264bbb4e638b0783d4d115dc3b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.769121 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9753ebb-92f7-4d2a-88a9-8aa61da3e409 admin admin] RBAC: Authorizing `identity:get_user(user_id=912e3b264bbb4e638b0783d4d115dc3b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.771378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9753ebb-92f7-4d2a-88a9-8aa61da3e409 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.772829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-84ca141b-2db0-4e54-9566-ee95688d2cda None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:14.773284 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 91/193] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/users/912e3b264bbb4e638b0783d4d115dc3b => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:14.774011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-84ca141b-2db0-4e54-9566-ee95688d2cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:14.778504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9753ebb-92f7-4d2a-88a9-8aa61da3e409 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.782371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 103/194] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:14.783663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ec7a8-e562-478e-9409-dc1a1b20e1d3 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.783972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ec7a8-e562-478e-9409-dc1a1b20e1d3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.784276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ec7a8-e562-478e-9409-dc1a1b20e1d3 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.785993 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 104/195] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:14.791238 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9753ebb-92f7-4d2a-88a9-8aa61da3e409 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.793241 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdca13-a5d9-4df4-bb6a-8b9f748409aa None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.793537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdca13-a5d9-4df4-bb6a-8b9f748409aa None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.793830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdca13-a5d9-4df4-bb6a-8b9f748409aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.796793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2d005-fc38-460e-9b6c-f6093d9c2418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.797735 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2d005-fc38-460e-9b6c-f6093d9c2418 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.798148 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2d005-fc38-460e-9b6c-f6093d9c2418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.798557 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2d005-fc38-460e-9b6c-f6093d9c2418 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.808287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2d005-fc38-460e-9b6c-f6093d9c2418 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.810062 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2d005-fc38-460e-9b6c-f6093d9c2418 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.811899 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-10fdca13-a5d9-4df4-bb6a-8b9f748409aa None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:14.814252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-10fdca13-a5d9-4df4-bb6a-8b9f748409aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:14.821328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 92/196] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:14.821740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 105/197] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:14.823120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2d005-fc38-460e-9b6c-f6093d9c2418 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.826920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdca13-a5d9-4df4-bb6a-8b9f748409aa None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.834451 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2d005-fc38-460e-9b6c-f6093d9c2418 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.838158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdca13-a5d9-4df4-bb6a-8b9f748409aa None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.838951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d84ba-ebbf-48a9-aad8-acbf5ee796c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.839740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d84ba-ebbf-48a9-aad8-acbf5ee796c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.840041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d84ba-ebbf-48a9-aad8-acbf5ee796c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.841927 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d84ba-ebbf-48a9-aad8-acbf5ee796c2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.845151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da7ecb-3f81-435e-9a93-fc641f1ab0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.846210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da7ecb-3f81-435e-9a93-fc641f1ab0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.846729 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da7ecb-3f81-435e-9a93-fc641f1ab0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.847152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da7ecb-3f81-435e-9a93-fc641f1ab0c2 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.848396 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da7ecb-3f81-435e-9a93-fc641f1ab0c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.850542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da7ecb-3f81-435e-9a93-fc641f1ab0c2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.852214 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 106/198] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:14.852955 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da7ecb-3f81-435e-9a93-fc641f1ab0c2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.857477 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d84ba-ebbf-48a9-aad8-acbf5ee796c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:14.862296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da7ecb-3f81-435e-9a93-fc641f1ab0c2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.865044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-c18d84ba-ebbf-48a9-aad8-acbf5ee796c2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:14.866287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 93/199] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:14.866600 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b47373-4493-4792-90d7-a62a71a58fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.867328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b47373-4493-4792-90d7-a62a71a58fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.867603 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b47373-4493-4792-90d7-a62a71a58fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.867875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b47373-4493-4792-90d7-a62a71a58fe5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.868906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d84ba-ebbf-48a9-aad8-acbf5ee796c2 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.869080 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b47373-4493-4792-90d7-a62a71a58fe5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.870773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b47373-4493-4792-90d7-a62a71a58fe5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.872521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 107/200] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:14.873246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b47373-4493-4792-90d7-a62a71a58fe5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.882924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b47373-4493-4792-90d7-a62a71a58fe5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.883163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d84ba-ebbf-48a9-aad8-acbf5ee796c2 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.887159 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f6d0b-ea50-4ad5-bed3-087b5213ba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.887508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d042e-56ff-48e8-b8df-7e44f7cff337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.887786 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6d0b-ea50-4ad5-bed3-087b5213ba1c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.888088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6d0b-ea50-4ad5-bed3-087b5213ba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.888178 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d042e-56ff-48e8-b8df-7e44f7cff337 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.888362 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f6d0b-ea50-4ad5-bed3-087b5213ba1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.888454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d042e-56ff-48e8-b8df-7e44f7cff337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.888687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d042e-56ff-48e8-b8df-7e44f7cff337 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.889080 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f6d0b-ea50-4ad5-bed3-087b5213ba1c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:14.889378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f6d0b-ea50-4ad5-bed3-087b5213ba1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.889746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d042e-56ff-48e8-b8df-7e44f7cff337 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=ac4c94add81c409d847b103179d99972, user.id=912e3b264bbb4e638b0783d4d115dc3b) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:14.890056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d042e-56ff-48e8-b8df-7e44f7cff337 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.891765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f6d0b-ea50-4ad5-bed3-087b5213ba1c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.892757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d042e-56ff-48e8-b8df-7e44f7cff337 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.898139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 94/201] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/role_assignments?user.id=912e3b264bbb4e638b0783d4d115dc3b&scope.project.id=ac4c94add81c409d847b103179d99972&role.id=0e45946c6336419abb2015d8916e31ca => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:14.898896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d042e-56ff-48e8-b8df-7e44f7cff337 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.900535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 108/202] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:14.908202 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f6d0b-ea50-4ad5-bed3-087b5213ba1c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.913094 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d042e-56ff-48e8-b8df-7e44f7cff337 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.917641 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c5cc4-e1cc-4ae4-a352-552e508a2d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.918330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5cc4-e1cc-4ae4-a352-552e508a2d3f admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.918616 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5cc4-e1cc-4ae4-a352-552e508a2d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.918892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c5cc4-e1cc-4ae4-a352-552e508a2d3f admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.919619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c5cc4-e1cc-4ae4-a352-552e508a2d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.921653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c5cc4-e1cc-4ae4-a352-552e508a2d3f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.922817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f6d0b-ea50-4ad5-bed3-087b5213ba1c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.927798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d0049-4ceb-411b-9c26-29b755d5f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.929020 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d0049-4ceb-411b-9c26-29b755d5f19a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.929443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d0049-4ceb-411b-9c26-29b755d5f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.929915 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d0049-4ceb-411b-9c26-29b755d5f19a admin admin] PATH_INFO: `/v3/users/912e3b264bbb4e638b0783d4d115dc3b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.931246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d0049-4ceb-411b-9c26-29b755d5f19a admin admin] RBAC: Authorizing `identity:get_user(user_id=912e3b264bbb4e638b0783d4d115dc3b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.933680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d0049-4ceb-411b-9c26-29b755d5f19a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.935660 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 109/203] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/users/912e3b264bbb4e638b0783d4d115dc3b => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:14.941913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d0049-4ceb-411b-9c26-29b755d5f19a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.945100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 95/204] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:14:14 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:14.952345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d0049-4ceb-411b-9c26-29b755d5f19a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:14.957714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29863ddc-38c1-46bf-b5cf-5c4f5d8429de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:14.958385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29863ddc-38c1-46bf-b5cf-5c4f5d8429de admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:14.958656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29863ddc-38c1-46bf-b5cf-5c4f5d8429de admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:14.958926 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29863ddc-38c1-46bf-b5cf-5c4f5d8429de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:14.968144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29863ddc-38c1-46bf-b5cf-5c4f5d8429de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:14.970732 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29863ddc-38c1-46bf-b5cf-5c4f5d8429de admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:14.981085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 110/205] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 09:14:14.987977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c5cc4-e1cc-4ae4-a352-552e508a2d3f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:14.998363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c5cc4-e1cc-4ae4-a352-552e508a2d3f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:15.003344 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed993725-6aaf-4d1b-b4b4-14dbd1e215d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:15.004282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed993725-6aaf-4d1b-b4b4-14dbd1e215d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:15.004569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed993725-6aaf-4d1b-b4b4-14dbd1e215d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:15.004849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed993725-6aaf-4d1b-b4b4-14dbd1e215d9 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:15.006225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed993725-6aaf-4d1b-b4b4-14dbd1e215d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:15.011407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed993725-6aaf-4d1b-b4b4-14dbd1e215d9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:15.011407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 96/206] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:14 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:15.018036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29863ddc-38c1-46bf-b5cf-5c4f5d8429de admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:15.027423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29863ddc-38c1-46bf-b5cf-5c4f5d8429de admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:15.035310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8c83a-c430-4a25-9e02-cae8ff8b22f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:15.035310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8c83a-c430-4a25-9e02-cae8ff8b22f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:15.035310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8c83a-c430-4a25-9e02-cae8ff8b22f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:15.035310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8c83a-c430-4a25-9e02-cae8ff8b22f6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:15.035702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8c83a-c430-4a25-9e02-cae8ff8b22f6 admin admin] RBAC: Adding query filter params (role.id=34d194b1309f45d9a8ad70d08ccb4230, scope.project.id=ac4c94add81c409d847b103179d99972, user.id=912e3b264bbb4e638b0783d4d115dc3b) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:15.035702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8c83a-c430-4a25-9e02-cae8ff8b22f6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:15.037201 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8c83a-c430-4a25-9e02-cae8ff8b22f6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:15.043838 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 111/207] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:15 2022] GET /identity/v3/role_assignments?user.id=912e3b264bbb4e638b0783d4d115dc3b&scope.project.id=ac4c94add81c409d847b103179d99972&role.id=34d194b1309f45d9a8ad70d08ccb4230 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:17.244641 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8aee-a3c3-4a54-b28d-547b2c5b841c None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.245613 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8aee-a3c3-4a54-b28d-547b2c5b841c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.246118 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8aee-a3c3-4a54-b28d-547b2c5b841c None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.248309 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 97/208] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:17.254457 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c71b8-04df-4ca6-a42e-de7e10721e3d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.255286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c71b8-04df-4ca6-a42e-de7e10721e3d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.255753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c71b8-04df-4ca6-a42e-de7e10721e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.275015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-367c71b8-04df-4ca6-a42e-de7e10721e3d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:17.276500 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-367c71b8-04df-4ca6-a42e-de7e10721e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:17.284197 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 112/209] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:17.306737 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8aee-a3c3-4a54-b28d-547b2c5b841c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.319992 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8aee-a3c3-4a54-b28d-547b2c5b841c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.324657 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae895d5d-4f41-4954-a86f-2582137fe828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.325662 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae895d5d-4f41-4954-a86f-2582137fe828 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.326140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae895d5d-4f41-4954-a86f-2582137fe828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.326600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae895d5d-4f41-4954-a86f-2582137fe828 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.339007 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae895d5d-4f41-4954-a86f-2582137fe828 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:17.346810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-ae895d5d-4f41-4954-a86f-2582137fe828 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:14:17.348363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 98/210] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:17.354635 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c71b8-04df-4ca6-a42e-de7e10721e3d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.364909 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c71b8-04df-4ca6-a42e-de7e10721e3d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.369671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ddd31-8664-44e0-be0c-496ece8144cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.370552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ddd31-8664-44e0-be0c-496ece8144cd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.370987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ddd31-8664-44e0-be0c-496ece8144cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.371413 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ddd31-8664-44e0-be0c-496ece8144cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.372429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ddd31-8664-44e0-be0c-496ece8144cd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:17.372904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ddd31-8664-44e0-be0c-496ece8144cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.374895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ddd31-8664-44e0-be0c-496ece8144cd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.385261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 113/211] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:17.392131 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae895d5d-4f41-4954-a86f-2582137fe828 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.403141 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae895d5d-4f41-4954-a86f-2582137fe828 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.408555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e12f3-0e94-47fb-b8ed-75fd641c2ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.409676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e12f3-0e94-47fb-b8ed-75fd641c2ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.410158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e12f3-0e94-47fb-b8ed-75fd641c2ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.410621 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e12f3-0e94-47fb-b8ed-75fd641c2ae3 admin admin] PATH_INFO: `/v3/users/912e3b264bbb4e638b0783d4d115dc3b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.412039 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e12f3-0e94-47fb-b8ed-75fd641c2ae3 admin admin] RBAC: Authorizing `identity:get_user(user_id=912e3b264bbb4e638b0783d4d115dc3b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.414395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e12f3-0e94-47fb-b8ed-75fd641c2ae3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.420372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 99/212] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/users/912e3b264bbb4e638b0783d4d115dc3b => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:17.422275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ddd31-8664-44e0-be0c-496ece8144cd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.432061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cba9d8-a0ae-4698-a094-89de03f262a6 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.432354 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cba9d8-a0ae-4698-a094-89de03f262a6 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.432633 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cba9d8-a0ae-4698-a094-89de03f262a6 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.433208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ddd31-8664-44e0-be0c-496ece8144cd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.434388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 100/213] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:17.438686 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e8652-b0e4-4755-8caa-ecb0f6b2bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.439799 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e8652-b0e4-4755-8caa-ecb0f6b2bed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.440288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e8652-b0e4-4755-8caa-ecb0f6b2bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.440436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59eb8-dd9f-42dc-82a2-2549b0950f44 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.440829 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59eb8-dd9f-42dc-82a2-2549b0950f44 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.441031 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e8652-b0e4-4755-8caa-ecb0f6b2bed3 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.441167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb59eb8-dd9f-42dc-82a2-2549b0950f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.442648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e8652-b0e4-4755-8caa-ecb0f6b2bed3 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.445231 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e8652-b0e4-4755-8caa-ecb0f6b2bed3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.447196 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 114/214] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:17.454069 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e8652-b0e4-4755-8caa-ecb0f6b2bed3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.463791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e8652-b0e4-4755-8caa-ecb0f6b2bed3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.464366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-eeb59eb8-dd9f-42dc-82a2-2549b0950f44 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:17.465553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-eeb59eb8-dd9f-42dc-82a2-2549b0950f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:17.468267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c44ac-0732-4bef-9bb0-41bb676d32b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.469236 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c44ac-0732-4bef-9bb0-41bb676d32b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.469510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c44ac-0732-4bef-9bb0-41bb676d32b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.469934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c44ac-0732-4bef-9bb0-41bb676d32b9 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972/users/912e3b264bbb4e638b0783d4d115dc3b/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.471841 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c44ac-0732-4bef-9bb0-41bb676d32b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4c94add81c409d847b103179d99972, user_id=912e3b264bbb4e638b0783d4d115dc3b, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.473660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 101/215] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:17.474521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c44ac-0732-4bef-9bb0-41bb676d32b9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.478064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed454-9037-4497-9839-9ab2a1434b9a None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.478694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed454-9037-4497-9839-9ab2a1434b9a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.478976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed454-9037-4497-9839-9ab2a1434b9a None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.480813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 102/216] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:17.484002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60002-ef08-458d-ae31-103c857e98a4 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.485019 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60002-ef08-458d-ae31-103c857e98a4 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.485450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb60002-ef08-458d-ae31-103c857e98a4 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.487395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 103/217] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:17.488667 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bda3d3-28a2-4e59-8ea5-9808dd44e22d None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.488955 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bda3d3-28a2-4e59-8ea5-9808dd44e22d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.489235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bda3d3-28a2-4e59-8ea5-9808dd44e22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.491528 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 115/218] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:17 2022] PUT /identity/v3/projects/ac4c94add81c409d847b103179d99972/users/912e3b264bbb4e638b0783d4d115dc3b/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:14:17.502392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeb174-406b-4039-9ff3-6e06ad6c9c67 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.502678 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeb174-406b-4039-9ff3-6e06ad6c9c67 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.502960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aeb174-406b-4039-9ff3-6e06ad6c9c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.508581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-37bda3d3-28a2-4e59-8ea5-9808dd44e22d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:17.509830 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-37bda3d3-28a2-4e59-8ea5-9808dd44e22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:17.522283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a7aeb174-406b-4039-9ff3-6e06ad6c9c67 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:17.523506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a7aeb174-406b-4039-9ff3-6e06ad6c9c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:17.572405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 104/219] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:17.577056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bda3d3-28a2-4e59-8ea5-9808dd44e22d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.588444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bda3d3-28a2-4e59-8ea5-9808dd44e22d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.591693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 116/220] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:17.593400 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d60dfd-1072-462d-b2fd-871951170c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.595035 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d60dfd-1072-462d-b2fd-871951170c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.595518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d60dfd-1072-462d-b2fd-871951170c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.595807 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d60dfd-1072-462d-b2fd-871951170c35 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.601417 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeb174-406b-4039-9ff3-6e06ad6c9c67 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.611898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aeb174-406b-4039-9ff3-6e06ad6c9c67 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.612257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d60dfd-1072-462d-b2fd-871951170c35 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:17.617466 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438cf73-9574-4992-a6ef-5fba59fa44cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.618531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438cf73-9574-4992-a6ef-5fba59fa44cf admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.618818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438cf73-9574-4992-a6ef-5fba59fa44cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.619093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438cf73-9574-4992-a6ef-5fba59fa44cf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.620050 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-75d60dfd-1072-462d-b2fd-871951170c35 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:17.621330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 105/221] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:17.627581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d60dfd-1072-462d-b2fd-871951170c35 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.631513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438cf73-9574-4992-a6ef-5fba59fa44cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:17.637658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d60dfd-1072-462d-b2fd-871951170c35 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.638545 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-5438cf73-9574-4992-a6ef-5fba59fa44cf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:17.640359 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 117/222] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:17.643564 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ec7da-7970-4b6a-8697-b899dd6dfc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.644410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ec7da-7970-4b6a-8697-b899dd6dfc6e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.644690 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ec7da-7970-4b6a-8697-b899dd6dfc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.644956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ec7da-7970-4b6a-8697-b899dd6dfc6e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.645828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438cf73-9574-4992-a6ef-5fba59fa44cf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.646245 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ec7da-7970-4b6a-8697-b899dd6dfc6e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.648044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ec7da-7970-4b6a-8697-b899dd6dfc6e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.649865 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 106/223] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:17.650471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ec7da-7970-4b6a-8697-b899dd6dfc6e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.661907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ec7da-7970-4b6a-8697-b899dd6dfc6e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.662142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438cf73-9574-4992-a6ef-5fba59fa44cf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.666195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df9a5e-4be6-4ade-82df-307bfbb49f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.666319 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7d26-265e-4968-8938-cf96d2ad2017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.666849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df9a5e-4be6-4ade-82df-307bfbb49f19 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.666947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7d26-265e-4968-8938-cf96d2ad2017 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.667131 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df9a5e-4be6-4ade-82df-307bfbb49f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.667225 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7d26-265e-4968-8938-cf96d2ad2017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.667401 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df9a5e-4be6-4ade-82df-307bfbb49f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.668054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd7d26-265e-4968-8938-cf96d2ad2017 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.668178 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df9a5e-4be6-4ade-82df-307bfbb49f19 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:17.668461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df9a5e-4be6-4ade-82df-307bfbb49f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.668807 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd7d26-265e-4968-8938-cf96d2ad2017 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:17.669754 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd7d26-265e-4968-8938-cf96d2ad2017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.670056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df9a5e-4be6-4ade-82df-307bfbb49f19 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.671350 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd7d26-265e-4968-8938-cf96d2ad2017 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.681084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 118/224] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:17.681985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7d26-265e-4968-8938-cf96d2ad2017 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.682090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 107/225] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:17.687790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df9a5e-4be6-4ade-82df-307bfbb49f19 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.692607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd7d26-265e-4968-8938-cf96d2ad2017 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.698291 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9af92-2a6a-415f-9a36-c85f9bdc3e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.698417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df9a5e-4be6-4ade-82df-307bfbb49f19 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.698948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9af92-2a6a-415f-9a36-c85f9bdc3e8c admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.699234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9af92-2a6a-415f-9a36-c85f9bdc3e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.699506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9af92-2a6a-415f-9a36-c85f9bdc3e8c admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.700257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9af92-2a6a-415f-9a36-c85f9bdc3e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.702187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9af92-2a6a-415f-9a36-c85f9bdc3e8c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.703026 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c806f6-8463-4683-a2c4-4b4897a4b85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.704611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c806f6-8463-4683-a2c4-4b4897a4b85e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.705002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c806f6-8463-4683-a2c4-4b4897a4b85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.705285 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c806f6-8463-4683-a2c4-4b4897a4b85e admin admin] PATH_INFO: `/v3/users/912e3b264bbb4e638b0783d4d115dc3b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.706511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c806f6-8463-4683-a2c4-4b4897a4b85e admin admin] RBAC: Authorizing `identity:get_user(user_id=912e3b264bbb4e638b0783d4d115dc3b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.708746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c806f6-8463-4683-a2c4-4b4897a4b85e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.710517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 108/226] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/users/912e3b264bbb4e638b0783d4d115dc3b => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:17.714947 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c806f6-8463-4683-a2c4-4b4897a4b85e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.726515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c806f6-8463-4683-a2c4-4b4897a4b85e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.727910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 119/227] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:14:17 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:17.728612 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9af92-2a6a-415f-9a36-c85f9bdc3e8c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.731630 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f341bb-31aa-4730-9f79-29d369aaea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.732666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f341bb-31aa-4730-9f79-29d369aaea57 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.733011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f341bb-31aa-4730-9f79-29d369aaea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.733437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f341bb-31aa-4730-9f79-29d369aaea57 admin admin] PATH_INFO: `/v3/users/99290bda8eaa4b8a9ba44d6234ee4c80` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.738987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9af92-2a6a-415f-9a36-c85f9bdc3e8c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.743535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560d42d-e89f-46c2-b714-6b47df4b5144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.744411 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560d42d-e89f-46c2-b714-6b47df4b5144 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.744681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560d42d-e89f-46c2-b714-6b47df4b5144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.744953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560d42d-e89f-46c2-b714-6b47df4b5144 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.746128 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560d42d-e89f-46c2-b714-6b47df4b5144 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.748212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560d42d-e89f-46c2-b714-6b47df4b5144 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.748751 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f341bb-31aa-4730-9f79-29d369aaea57 admin admin] RBAC: Authorizing `identity:get_user(user_id=99290bda8eaa4b8a9ba44d6234ee4c80)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.750081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 120/228] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:17.751326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f341bb-31aa-4730-9f79-29d369aaea57 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.753404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 109/229] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/users/99290bda8eaa4b8a9ba44d6234ee4c80 => generated 297 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:17.755832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560d42d-e89f-46c2-b714-6b47df4b5144 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.758759 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f341bb-31aa-4730-9f79-29d369aaea57 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.767780 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560d42d-e89f-46c2-b714-6b47df4b5144 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.769385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f341bb-31aa-4730-9f79-29d369aaea57 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.772306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d9b84-bb38-4036-843d-9e24967f4b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.773199 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d9b84-bb38-4036-843d-9e24967f4b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.773493 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d9b84-bb38-4036-843d-9e24967f4b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.773750 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d9b84-bb38-4036-843d-9e24967f4b0a admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972/users/912e3b264bbb4e638b0783d4d115dc3b/roles/34d194b1309f45d9a8ad70d08ccb4230` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.774102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d2a29-020f-43c9-ab85-f86863a7dc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.774816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d2a29-020f-43c9-ab85-f86863a7dc48 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.775104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d2a29-020f-43c9-ab85-f86863a7dc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.775483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d2a29-020f-43c9-ab85-f86863a7dc48 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.776212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d9b84-bb38-4036-843d-9e24967f4b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4c94add81c409d847b103179d99972, user_id=912e3b264bbb4e638b0783d4d115dc3b, role_id=34d194b1309f45d9a8ad70d08ccb4230)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.779067 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d9b84-bb38-4036-843d-9e24967f4b0a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.792506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d2a29-020f-43c9-ab85-f86863a7dc48 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.794652 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d2a29-020f-43c9-ab85-f86863a7dc48 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.799525 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 121/230] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:17 2022] PUT /identity/v3/projects/ac4c94add81c409d847b103179d99972/users/912e3b264bbb4e638b0783d4d115dc3b/roles/34d194b1309f45d9a8ad70d08ccb4230 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:17.810793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 110/231] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 09:14:17.818074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d9b84-bb38-4036-843d-9e24967f4b0a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.904107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d9b84-bb38-4036-843d-9e24967f4b0a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.909610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ab6c8-1cf6-4ea2-a3b2-21d34fb54620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.910878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab6c8-1cf6-4ea2-a3b2-21d34fb54620 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.911368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab6c8-1cf6-4ea2-a3b2-21d34fb54620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.911863 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ab6c8-1cf6-4ea2-a3b2-21d34fb54620 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.913667 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ab6c8-1cf6-4ea2-a3b2-21d34fb54620 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.916122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ab6c8-1cf6-4ea2-a3b2-21d34fb54620 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.918484 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 122/232] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:17.925063 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d2a29-020f-43c9-ab85-f86863a7dc48 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:17.935326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d2a29-020f-43c9-ab85-f86863a7dc48 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:17.941387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2eafa-03f8-46cf-8368-49d8e47416a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:17.942469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2eafa-03f8-46cf-8368-49d8e47416a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:17.942852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2eafa-03f8-46cf-8368-49d8e47416a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:17.943198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2eafa-03f8-46cf-8368-49d8e47416a3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:17.944148 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2eafa-03f8-46cf-8368-49d8e47416a3 admin admin] RBAC: Adding query filter params (role.id=4184b38195d04c3a88c76c1255f7c7f7, scope.project.id=ac4c94add81c409d847b103179d99972, user.id=99290bda8eaa4b8a9ba44d6234ee4c80) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:17.944528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2eafa-03f8-46cf-8368-49d8e47416a3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:17.946545 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2eafa-03f8-46cf-8368-49d8e47416a3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:17.953232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 111/233] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:17 2022] GET /identity/v3/role_assignments?user.id=99290bda8eaa4b8a9ba44d6234ee4c80&scope.project.id=ac4c94add81c409d847b103179d99972&role.id=4184b38195d04c3a88c76c1255f7c7f7 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:20.452257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e1514-e39b-440b-a0be-f9b4abbfbeb3 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.452986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e1514-e39b-440b-a0be-f9b4abbfbeb3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.452986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e1514-e39b-440b-a0be-f9b4abbfbeb3 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.455459 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 123/234] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:20.478101 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0f67d-bf2d-4982-886a-7b19668fb540 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.478760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0f67d-bf2d-4982-886a-7b19668fb540 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.478760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0f67d-bf2d-4982-886a-7b19668fb540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.505688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-f5c0f67d-bf2d-4982-886a-7b19668fb540 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:20.506918 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f5c0f67d-bf2d-4982-886a-7b19668fb540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:20.517499 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 112/235] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:20.553959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e1514-e39b-440b-a0be-f9b4abbfbeb3 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:20.569887 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e1514-e39b-440b-a0be-f9b4abbfbeb3 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:20.577583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcefc5-cf20-46d1-8041-2b29146aa3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:20.578404 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcefc5-cf20-46d1-8041-2b29146aa3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.578687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcefc5-cf20-46d1-8041-2b29146aa3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.578962 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcefc5-cf20-46d1-8041-2b29146aa3c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.596196 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bcefc5-cf20-46d1-8041-2b29146aa3c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:20.603015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-56bcefc5-cf20-46d1-8041-2b29146aa3c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:14:20.604266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 124/236] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:14:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:20.610593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0f67d-bf2d-4982-886a-7b19668fb540 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:20.619856 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0f67d-bf2d-4982-886a-7b19668fb540 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:20.632705 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec775e34-023a-4484-9919-e3fe11d6c39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:20.633393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec775e34-023a-4484-9919-e3fe11d6c39f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.633681 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec775e34-023a-4484-9919-e3fe11d6c39f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.633964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec775e34-023a-4484-9919-e3fe11d6c39f admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.634789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec775e34-023a-4484-9919-e3fe11d6c39f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:20.635102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec775e34-023a-4484-9919-e3fe11d6c39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:20.636740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec775e34-023a-4484-9919-e3fe11d6c39f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:20.646104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 113/237] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:20.651588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcefc5-cf20-46d1-8041-2b29146aa3c2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:20.663750 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcefc5-cf20-46d1-8041-2b29146aa3c2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:20.673780 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ce406-18f1-428c-937a-2b04701b899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:20.674697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ce406-18f1-428c-937a-2b04701b899d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.674983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ce406-18f1-428c-937a-2b04701b899d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.675258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ce406-18f1-428c-937a-2b04701b899d admin admin] PATH_INFO: `/v3/users/912e3b264bbb4e638b0783d4d115dc3b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.676555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ce406-18f1-428c-937a-2b04701b899d admin admin] RBAC: Authorizing `identity:get_user(user_id=912e3b264bbb4e638b0783d4d115dc3b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:20.678687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ce406-18f1-428c-937a-2b04701b899d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:20.680548 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 125/238] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:20 2022] GET /identity/v3/users/912e3b264bbb4e638b0783d4d115dc3b => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:20.685796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec775e34-023a-4484-9919-e3fe11d6c39f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:20.696666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec775e34-023a-4484-9919-e3fe11d6c39f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:20.707344 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1de3e6-e49d-4223-8852-1de1e5c4e5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:20.707931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1de3e6-e49d-4223-8852-1de1e5c4e5da admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.708236 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1de3e6-e49d-4223-8852-1de1e5c4e5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.708510 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1de3e6-e49d-4223-8852-1de1e5c4e5da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.717082 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1de3e6-e49d-4223-8852-1de1e5c4e5da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:20.719457 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1de3e6-e49d-4223-8852-1de1e5c4e5da admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:20.730741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e706db-0a6c-44d1-886f-398b7e9dde3e None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.731011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e706db-0a6c-44d1-886f-398b7e9dde3e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.731302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e706db-0a6c-44d1-886f-398b7e9dde3e None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.733164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 126/239] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:20.733511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 114/240] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:20.739597 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e706db-0a6c-44d1-886f-398b7e9dde3e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:20.744466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94646ec9-ae9a-4c34-8151-a864e4b8bc08 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.744748 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94646ec9-ae9a-4c34-8151-a864e4b8bc08 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.745021 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94646ec9-ae9a-4c34-8151-a864e4b8bc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.762864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e706db-0a6c-44d1-886f-398b7e9dde3e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:20.773549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b9ff9-a8fa-49d1-b0e5-4e831c6877c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:20.774389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b9ff9-a8fa-49d1-b0e5-4e831c6877c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.774663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b9ff9-a8fa-49d1-b0e5-4e831c6877c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.774934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b9ff9-a8fa-49d1-b0e5-4e831c6877c7 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.776965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b9ff9-a8fa-49d1-b0e5-4e831c6877c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:20.779000 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b9ff9-a8fa-49d1-b0e5-4e831c6877c7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:20.780882 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 127/241] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:20 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:20.785573 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-94646ec9-ae9a-4c34-8151-a864e4b8bc08 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:20.787010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-94646ec9-ae9a-4c34-8151-a864e4b8bc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:20.787825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b9ff9-a8fa-49d1-b0e5-4e831c6877c7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:20.798188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b9ff9-a8fa-49d1-b0e5-4e831c6877c7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:20.802552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4fb7e-73a0-49ba-9426-c89b7a358765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:20.803185 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4fb7e-73a0-49ba-9426-c89b7a358765 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.803464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4fb7e-73a0-49ba-9426-c89b7a358765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.803738 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4fb7e-73a0-49ba-9426-c89b7a358765 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.804692 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4fb7e-73a0-49ba-9426-c89b7a358765 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=ac4c94add81c409d847b103179d99972, user.id=912e3b264bbb4e638b0783d4d115dc3b) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:20.805003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4fb7e-73a0-49ba-9426-c89b7a358765 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:20.805949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 115/242] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:20.806833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4fb7e-73a0-49ba-9426-c89b7a358765 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:20.814515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eb667-d832-4cc3-aef5-368b6d3e2e64 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.814515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eb667-d832-4cc3-aef5-368b6d3e2e64 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.814899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eb667-d832-4cc3-aef5-368b6d3e2e64 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.816548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 116/243] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:20.819867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 128/244] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:20 2022] GET /identity/v3/role_assignments?user.id=912e3b264bbb4e638b0783d4d115dc3b&scope.project.id=ac4c94add81c409d847b103179d99972&role.id=0e45946c6336419abb2015d8916e31ca => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:20.822236 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1da84-582b-410f-a8e4-93ebb9f4f149 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.822756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1da84-582b-410f-a8e4-93ebb9f4f149 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.823229 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1da84-582b-410f-a8e4-93ebb9f4f149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.834578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4fb7e-73a0-49ba-9426-c89b7a358765 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:20.845654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4fb7e-73a0-49ba-9426-c89b7a358765 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:20.856123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778aa7f-483e-49bf-960c-2ba17c47cb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:20.856123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778aa7f-483e-49bf-960c-2ba17c47cb21 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.856123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778aa7f-483e-49bf-960c-2ba17c47cb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.856123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778aa7f-483e-49bf-960c-2ba17c47cb21 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.868472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-d1f1da84-582b-410f-a8e4-93ebb9f4f149 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:20.869676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d1f1da84-582b-410f-a8e4-93ebb9f4f149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:20.871502 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778aa7f-483e-49bf-960c-2ba17c47cb21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:20.883178 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-7778aa7f-483e-49bf-960c-2ba17c47cb21 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:20.884489 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 129/245] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:20.894408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778aa7f-483e-49bf-960c-2ba17c47cb21 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:20.896958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 117/246] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:20.908552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778aa7f-483e-49bf-960c-2ba17c47cb21 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:20.909000 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310fc39-78b3-4e12-a9d9-dedba22a88e2 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.909284 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310fc39-78b3-4e12-a9d9-dedba22a88e2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.909558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310fc39-78b3-4e12-a9d9-dedba22a88e2 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.911600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 118/247] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:20.912815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa5588-c545-4f65-88d3-c826e4b831d9 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.913095 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa5588-c545-4f65-88d3-c826e4b831d9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.913370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa5588-c545-4f65-88d3-c826e4b831d9 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.915377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 119/248] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:20.915735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae176c1d-56b9-4f69-b42e-333b6186235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:20.916868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae176c1d-56b9-4f69-b42e-333b6186235f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.917368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae176c1d-56b9-4f69-b42e-333b6186235f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.917859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae176c1d-56b9-4f69-b42e-333b6186235f admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.918862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae176c1d-56b9-4f69-b42e-333b6186235f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:20.919367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae176c1d-56b9-4f69-b42e-333b6186235f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:20.920528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ea84-217d-4e6f-8c7d-31e8ba451dea None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.920815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ea84-217d-4e6f-8c7d-31e8ba451dea None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.921092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ea84-217d-4e6f-8c7d-31e8ba451dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.922219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae176c1d-56b9-4f69-b42e-333b6186235f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:20.931861 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 130/249] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:20.933543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9993e-ec39-439d-8d8b-c2409a8733e1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.934032 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9993e-ec39-439d-8d8b-c2409a8733e1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.934503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9993e-ec39-439d-8d8b-c2409a8733e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.941810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-bf75ea84-217d-4e6f-8c7d-31e8ba451dea None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:20.944210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-bf75ea84-217d-4e6f-8c7d-31e8ba451dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:20.952906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 120/250] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:20.954366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75ea84-217d-4e6f-8c7d-31e8ba451dea None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:20.955508 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-aef9993e-ec39-439d-8d8b-c2409a8733e1 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:20.956940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-aef9993e-ec39-439d-8d8b-c2409a8733e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:20.964824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75ea84-217d-4e6f-8c7d-31e8ba451dea None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:20.966140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 131/251] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:20.966940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9993e-ec39-439d-8d8b-c2409a8733e1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:20.976671 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c056ae7-ef93-476e-8827-012d4fb0a0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:20.977483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c056ae7-ef93-476e-8827-012d4fb0a0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.977760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c056ae7-ef93-476e-8827-012d4fb0a0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.978034 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c056ae7-ef93-476e-8827-012d4fb0a0a7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.978578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9993e-ec39-439d-8d8b-c2409a8733e1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:20.991767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bb092-c0fd-49da-84c2-25fd3755ec9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:20.992681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bb092-c0fd-49da-84c2-25fd3755ec9f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:20.992966 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bb092-c0fd-49da-84c2-25fd3755ec9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:20.993241 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0bb092-c0fd-49da-84c2-25fd3755ec9f admin admin] PATH_INFO: `/v3/users/912e3b264bbb4e638b0783d4d115dc3b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:20.994907 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bb092-c0fd-49da-84c2-25fd3755ec9f admin admin] RBAC: Authorizing `identity:get_user(user_id=912e3b264bbb4e638b0783d4d115dc3b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:20.995331 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c056ae7-ef93-476e-8827-012d4fb0a0a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:20.997117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0bb092-c0fd-49da-84c2-25fd3755ec9f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.003560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 132/252] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:20 2022] GET /identity/v3/users/912e3b264bbb4e638b0783d4d115dc3b => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:21.003560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bb092-c0fd-49da-84c2-25fd3755ec9f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.008244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-9c056ae7-ef93-476e-8827-012d4fb0a0a7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:21.009721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 121/253] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:21.010496 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c056ae7-ef93-476e-8827-012d4fb0a0a7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.012162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0bb092-c0fd-49da-84c2-25fd3755ec9f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.019976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be3748-69c0-4cc9-97cd-10caded0d1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.022898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be3748-69c0-4cc9-97cd-10caded0d1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.022898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be3748-69c0-4cc9-97cd-10caded0d1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.023063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be3748-69c0-4cc9-97cd-10caded0d1f1 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.026916 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c056ae7-ef93-476e-8827-012d4fb0a0a7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.032699 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f3bb7-51b9-40f5-aa97-e28d01a62465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.033612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f3bb7-51b9-40f5-aa97-e28d01a62465 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.033894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f3bb7-51b9-40f5-aa97-e28d01a62465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.034167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f3bb7-51b9-40f5-aa97-e28d01a62465 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.035353 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f3bb7-51b9-40f5-aa97-e28d01a62465 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.036152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be3748-69c0-4cc9-97cd-10caded0d1f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:21.037165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f3bb7-51b9-40f5-aa97-e28d01a62465 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.038943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 122/254] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:21.039513 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f3bb7-51b9-40f5-aa97-e28d01a62465 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.042989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-47be3748-69c0-4cc9-97cd-10caded0d1f1 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 09:14:21.044222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 133/255] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:21.045438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be3748-69c0-4cc9-97cd-10caded0d1f1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.057744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be3748-69c0-4cc9-97cd-10caded0d1f1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.060571 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f3bb7-51b9-40f5-aa97-e28d01a62465 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.063514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ddc54-b15b-4188-a0cd-fd044b66daf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.064209 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ddc54-b15b-4188-a0cd-fd044b66daf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.064485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ddc54-b15b-4188-a0cd-fd044b66daf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.064751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ddc54-b15b-4188-a0cd-fd044b66daf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.065494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ddc54-b15b-4188-a0cd-fd044b66daf1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:21.065799 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ddc54-b15b-4188-a0cd-fd044b66daf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.067373 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ddc54-b15b-4188-a0cd-fd044b66daf1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.068201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666c05-eea1-4983-8273-36e7295b3411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.068890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666c05-eea1-4983-8273-36e7295b3411 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.069118 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666c05-eea1-4983-8273-36e7295b3411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.069390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666c05-eea1-4983-8273-36e7295b3411 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.077613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 134/256] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:21.080192 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ddc54-b15b-4188-a0cd-fd044b66daf1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.083324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a666c05-eea1-4983-8273-36e7295b3411 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.085163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a666c05-eea1-4983-8273-36e7295b3411 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.089671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ddc54-b15b-4188-a0cd-fd044b66daf1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.095042 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfff39a-e9a8-45cc-a3b7-aa12238b272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.095672 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfff39a-e9a8-45cc-a3b7-aa12238b272d admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.095869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 123/257] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:21.095967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfff39a-e9a8-45cc-a3b7-aa12238b272d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.096318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfff39a-e9a8-45cc-a3b7-aa12238b272d admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.097130 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfff39a-e9a8-45cc-a3b7-aa12238b272d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.099048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfff39a-e9a8-45cc-a3b7-aa12238b272d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.101064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666c05-eea1-4983-8273-36e7295b3411 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.111043 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666c05-eea1-4983-8273-36e7295b3411 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.115895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433fd3-2fea-4270-966b-49b7c7089183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.116587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433fd3-2fea-4270-966b-49b7c7089183 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.116885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433fd3-2fea-4270-966b-49b7c7089183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.117153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433fd3-2fea-4270-966b-49b7c7089183 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.117885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9433fd3-2fea-4270-966b-49b7c7089183 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:21.118185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9433fd3-2fea-4270-966b-49b7c7089183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.119251 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 135/258] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:14:21 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:21.119770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9433fd3-2fea-4270-966b-49b7c7089183 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.120051 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfff39a-e9a8-45cc-a3b7-aa12238b272d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.130230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfff39a-e9a8-45cc-a3b7-aa12238b272d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.132214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 124/259] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:21.133144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433fd3-2fea-4270-966b-49b7c7089183 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.141894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b462a-41ec-4d05-9e6a-0a2628bce58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.143379 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b462a-41ec-4d05-9e6a-0a2628bce58d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.143861 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b462a-41ec-4d05-9e6a-0a2628bce58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.144414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b462a-41ec-4d05-9e6a-0a2628bce58d admin admin] PATH_INFO: `/v3/users/99290bda8eaa4b8a9ba44d6234ee4c80` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.148213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b462a-41ec-4d05-9e6a-0a2628bce58d admin admin] RBAC: Authorizing `identity:get_user(user_id=99290bda8eaa4b8a9ba44d6234ee4c80)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.150479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b462a-41ec-4d05-9e6a-0a2628bce58d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.151578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433fd3-2fea-4270-966b-49b7c7089183 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.152673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 136/260] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:21 2022] GET /identity/v3/users/99290bda8eaa4b8a9ba44d6234ee4c80 => generated 297 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:21.153301 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b462a-41ec-4d05-9e6a-0a2628bce58d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.160685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d512f-e96f-4a0c-a2f0-98bdc3c3f82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.161564 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d512f-e96f-4a0c-a2f0-98bdc3c3f82b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.161853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d512f-e96f-4a0c-a2f0-98bdc3c3f82b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.162134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d512f-e96f-4a0c-a2f0-98bdc3c3f82b admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.163362 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d512f-e96f-4a0c-a2f0-98bdc3c3f82b admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.165485 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d512f-e96f-4a0c-a2f0-98bdc3c3f82b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.167215 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 125/261] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:21 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:21.167622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b462a-41ec-4d05-9e6a-0a2628bce58d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.167986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d512f-e96f-4a0c-a2f0-98bdc3c3f82b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.176467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bd554-6d91-4949-b4df-58b790f9e755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.177643 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bd554-6d91-4949-b4df-58b790f9e755 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.178093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bd554-6d91-4949-b4df-58b790f9e755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.178536 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bd554-6d91-4949-b4df-58b790f9e755 admin admin] PATH_INFO: `/v3/users/51d9fa6d5326486da9852ee45c7dc757` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.183384 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d512f-e96f-4a0c-a2f0-98bdc3c3f82b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.188524 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83c12a-d3c3-4b22-abd9-7a2692ed4f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.189407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83c12a-d3c3-4b22-abd9-7a2692ed4f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.189689 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83c12a-d3c3-4b22-abd9-7a2692ed4f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.189962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83c12a-d3c3-4b22-abd9-7a2692ed4f93 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.191194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83c12a-d3c3-4b22-abd9-7a2692ed4f93 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.193300 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83c12a-d3c3-4b22-abd9-7a2692ed4f93 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.195278 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 126/262] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:21 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:21.195911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83c12a-d3c3-4b22-abd9-7a2692ed4f93 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.196452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bd554-6d91-4949-b4df-58b790f9e755 admin admin] RBAC: Authorizing `identity:get_user(user_id=51d9fa6d5326486da9852ee45c7dc757)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.198647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bd554-6d91-4949-b4df-58b790f9e755 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.200458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 137/263] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:21 2022] GET /identity/v3/users/51d9fa6d5326486da9852ee45c7dc757 => generated 297 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:21.201210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bd554-6d91-4949-b4df-58b790f9e755 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.216161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bd554-6d91-4949-b4df-58b790f9e755 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.219425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83c12a-d3c3-4b22-abd9-7a2692ed4f93 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.221098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076422a-75d6-4473-920f-a09a204ce2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.222007 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076422a-75d6-4473-920f-a09a204ce2c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.222302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076422a-75d6-4473-920f-a09a204ce2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.222550 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076422a-75d6-4473-920f-a09a204ce2c2 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972/users/99290bda8eaa4b8a9ba44d6234ee4c80/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.223881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b9d0b-016e-4b71-bb21-bac9fe73aa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.224586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076422a-75d6-4473-920f-a09a204ce2c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4c94add81c409d847b103179d99972, user_id=99290bda8eaa4b8a9ba44d6234ee4c80, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.224689 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b9d0b-016e-4b71-bb21-bac9fe73aa0a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.224871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b9d0b-016e-4b71-bb21-bac9fe73aa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.225136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b9d0b-016e-4b71-bb21-bac9fe73aa0a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.225966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b9d0b-016e-4b71-bb21-bac9fe73aa0a admin admin] RBAC: Adding query filter params (role.id=34d194b1309f45d9a8ad70d08ccb4230, scope.project.id=ac4c94add81c409d847b103179d99972, user.id=912e3b264bbb4e638b0783d4d115dc3b) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:21.226275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b9d0b-016e-4b71-bb21-bac9fe73aa0a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.227215 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076422a-75d6-4473-920f-a09a204ce2c2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.228141 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b9d0b-016e-4b71-bb21-bac9fe73aa0a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.235549 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 127/264] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:21 2022] GET /identity/v3/role_assignments?user.id=912e3b264bbb4e638b0783d4d115dc3b&scope.project.id=ac4c94add81c409d847b103179d99972&role.id=34d194b1309f45d9a8ad70d08ccb4230 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:21.236454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b9d0b-016e-4b71-bb21-bac9fe73aa0a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.253762 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b9d0b-016e-4b71-bb21-bac9fe73aa0a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.258418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 138/265] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:21 2022] PUT /identity/v3/projects/ac4c94add81c409d847b103179d99972/users/99290bda8eaa4b8a9ba44d6234ee4c80/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:21.324933 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618f20f-ee6c-4b5d-995a-4f967746462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.325613 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618f20f-ee6c-4b5d-995a-4f967746462f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.325893 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618f20f-ee6c-4b5d-995a-4f967746462f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.326163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618f20f-ee6c-4b5d-995a-4f967746462f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.337560 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618f20f-ee6c-4b5d-995a-4f967746462f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.339477 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1618f20f-ee6c-4b5d-995a-4f967746462f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.351144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 128/266] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:21.357571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076422a-75d6-4473-920f-a09a204ce2c2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.369348 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076422a-75d6-4473-920f-a09a204ce2c2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.376776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefc262-7935-42ba-a368-6d3764d1eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.377654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefc262-7935-42ba-a368-6d3764d1eceb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.377933 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefc262-7935-42ba-a368-6d3764d1eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.378201 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefc262-7935-42ba-a368-6d3764d1eceb admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.379494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefc262-7935-42ba-a368-6d3764d1eceb admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.381679 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefc262-7935-42ba-a368-6d3764d1eceb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.383666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 139/267] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:21 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:21.390169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618f20f-ee6c-4b5d-995a-4f967746462f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:21.400060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618f20f-ee6c-4b5d-995a-4f967746462f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:21.404910 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac368d-36b9-4c8a-90d9-489fbf66a5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:21.405588 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac368d-36b9-4c8a-90d9-489fbf66a5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:21.405865 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac368d-36b9-4c8a-90d9-489fbf66a5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:21.406256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac368d-36b9-4c8a-90d9-489fbf66a5f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:21.407658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac368d-36b9-4c8a-90d9-489fbf66a5f0 admin admin] RBAC: Adding query filter params (role.id=da2cc800c7ad48d3a58d60617c9ed38e, scope.project.id=ac4c94add81c409d847b103179d99972, user.id=51d9fa6d5326486da9852ee45c7dc757) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:21.407961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac368d-36b9-4c8a-90d9-489fbf66a5f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:21.409911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac368d-36b9-4c8a-90d9-489fbf66a5f0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:21.416458 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 129/268] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:21 2022] GET /identity/v3/role_assignments?user.id=51d9fa6d5326486da9852ee45c7dc757&scope.project.id=ac4c94add81c409d847b103179d99972&role.id=da2cc800c7ad48d3a58d60617c9ed38e => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:23.865610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1f8ac-fb03-4ca6-a468-cdde63e5b9f8 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:23.866140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1f8ac-fb03-4ca6-a468-cdde63e5b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:23.866140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1f8ac-fb03-4ca6-a468-cdde63e5b9f8 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:23.868424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 140/269] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:23.873902 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1774f5-0f51-44bc-8cf4-f5ac002b3a06 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:23.874348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1774f5-0f51-44bc-8cf4-f5ac002b3a06 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:23.874448 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1774f5-0f51-44bc-8cf4-f5ac002b3a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:23.893385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd63199-0540-474b-ac9d-27efcdf5a6a2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:23.893885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd63199-0540-474b-ac9d-27efcdf5a6a2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:23.893990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0a1774f5-0f51-44bc-8cf4-f5ac002b3a06 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:23.894423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd63199-0540-474b-ac9d-27efcdf5a6a2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:23.895152 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0a1774f5-0f51-44bc-8cf4-f5ac002b3a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:23.897620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 141/270] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:23.903435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467788e-a70e-44bf-8103-101a0c0df092 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:23.903685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467788e-a70e-44bf-8103-101a0c0df092 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:23.903959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467788e-a70e-44bf-8103-101a0c0df092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:23.905368 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 130/271] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:23.907051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74e867-155d-469b-8239-e61ace7e3088 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:23.909988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74e867-155d-469b-8239-e61ace7e3088 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:23.909988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74e867-155d-469b-8239-e61ace7e3088 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:23.909988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 131/272] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:23.917408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4846b-2096-4e2b-a05a-9467709190b7 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:23.919128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4846b-2096-4e2b-a05a-9467709190b7 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:23.919128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4846b-2096-4e2b-a05a-9467709190b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:23.932585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0467788e-a70e-44bf-8103-101a0c0df092 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:23.933862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0467788e-a70e-44bf-8103-101a0c0df092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:23.939313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-65f4846b-2096-4e2b-a05a-9467709190b7 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:23.940525 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-65f4846b-2096-4e2b-a05a-9467709190b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:23.943027 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 142/273] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:23.943855 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467788e-a70e-44bf-8103-101a0c0df092 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:23.949375 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 132/274] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:23.956780 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467788e-a70e-44bf-8103-101a0c0df092 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:23.961436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da643a0b-f7f1-4c10-8bab-c44efeff12d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:23.962433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da643a0b-f7f1-4c10-8bab-c44efeff12d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:23.962919 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da643a0b-f7f1-4c10-8bab-c44efeff12d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:23.963395 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da643a0b-f7f1-4c10-8bab-c44efeff12d5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:23.970558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4846b-2096-4e2b-a05a-9467709190b7 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:23.975810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da643a0b-f7f1-4c10-8bab-c44efeff12d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:23.980214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4846b-2096-4e2b-a05a-9467709190b7 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:23.982722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-da643a0b-f7f1-4c10-8bab-c44efeff12d5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:23.983922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 143/275] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:23.985365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da643a0b-f7f1-4c10-8bab-c44efeff12d5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:23.986130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8341e6-c473-4355-9dad-e55b9816fc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:23.986919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8341e6-c473-4355-9dad-e55b9816fc0e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:23.987196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8341e6-c473-4355-9dad-e55b9816fc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:23.987466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8341e6-c473-4355-9dad-e55b9816fc0e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:23.988819 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8341e6-c473-4355-9dad-e55b9816fc0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:23.990543 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8341e6-c473-4355-9dad-e55b9816fc0e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:23.992128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 133/276] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:23.993261 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f25557-0aad-4a3e-9625-fa1b399670af None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:23.993542 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f25557-0aad-4a3e-9625-fa1b399670af None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:23.993810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f25557-0aad-4a3e-9625-fa1b399670af None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:23.995404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 134/277] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:23.996799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f25557-0aad-4a3e-9625-fa1b399670af None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:23.997370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da643a0b-f7f1-4c10-8bab-c44efeff12d5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.001959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2325d50-e7c3-4f13-b3b7-5a2041d41462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.002709 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2325d50-e7c3-4f13-b3b7-5a2041d41462 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.002990 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2325d50-e7c3-4f13-b3b7-5a2041d41462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.003265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2325d50-e7c3-4f13-b3b7-5a2041d41462 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.009218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f25557-0aad-4a3e-9625-fa1b399670af None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.013629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f1d2c-f45f-4b22-902b-a19f1d20ae17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.014047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2325d50-e7c3-4f13-b3b7-5a2041d41462 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:24.014253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1d2c-f45f-4b22-902b-a19f1d20ae17 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.014791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1d2c-f45f-4b22-902b-a19f1d20ae17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.015059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1d2c-f45f-4b22-902b-a19f1d20ae17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.015931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f1d2c-f45f-4b22-902b-a19f1d20ae17 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:24.016253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f1d2c-f45f-4b22-902b-a19f1d20ae17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.017808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f1d2c-f45f-4b22-902b-a19f1d20ae17 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.021459 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a2325d50-e7c3-4f13-b3b7-5a2041d41462 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:24.022641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 144/278] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:24.023459 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2325d50-e7c3-4f13-b3b7-5a2041d41462 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.030149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 135/279] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:24.030149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d3a37-a6b9-4d9a-a186-b6597c0ea9e9 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.030149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d3a37-a6b9-4d9a-a186-b6597c0ea9e9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.030149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d3a37-a6b9-4d9a-a186-b6597c0ea9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.034049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2325d50-e7c3-4f13-b3b7-5a2041d41462 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.038441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecb717-dbef-4162-b459-ef6e1d91c6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.039079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecb717-dbef-4162-b459-ef6e1d91c6ad admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.039356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecb717-dbef-4162-b459-ef6e1d91c6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.039626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecb717-dbef-4162-b459-ef6e1d91c6ad admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.040356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecb717-dbef-4162-b459-ef6e1d91c6ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.042256 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecb717-dbef-4162-b459-ef6e1d91c6ad admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.047541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-d81d3a37-a6b9-4d9a-a186-b6597c0ea9e9 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:24.048732 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d81d3a37-a6b9-4d9a-a186-b6597c0ea9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:24.056697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 136/280] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:24.057641 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d3a37-a6b9-4d9a-a186-b6597c0ea9e9 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.063093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 145/281] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:14:24 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:24.064071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecb717-dbef-4162-b459-ef6e1d91c6ad admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.073939 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecb717-dbef-4162-b459-ef6e1d91c6ad admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.079448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d2bbe-388a-45ed-98a4-9de592a6819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.080365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d2bbe-388a-45ed-98a4-9de592a6819d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.080646 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d2bbe-388a-45ed-98a4-9de592a6819d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.080916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d2bbe-388a-45ed-98a4-9de592a6819d admin admin] PATH_INFO: `/v3/users/99290bda8eaa4b8a9ba44d6234ee4c80` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.081554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d3a37-a6b9-4d9a-a186-b6597c0ea9e9 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.082234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d2bbe-388a-45ed-98a4-9de592a6819d admin admin] RBAC: Authorizing `identity:get_user(user_id=99290bda8eaa4b8a9ba44d6234ee4c80)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.084510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d2bbe-388a-45ed-98a4-9de592a6819d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.086360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158ab65-e093-4806-9812-7f7051a7a511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.086490 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 146/282] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:24 2022] GET /identity/v3/users/99290bda8eaa4b8a9ba44d6234ee4c80 => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:24.086823 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158ab65-e093-4806-9812-7f7051a7a511 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.087020 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d2bbe-388a-45ed-98a4-9de592a6819d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.087134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158ab65-e093-4806-9812-7f7051a7a511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.087366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158ab65-e093-4806-9812-7f7051a7a511 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.092079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158ab65-e093-4806-9812-7f7051a7a511 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:24.092079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158ab65-e093-4806-9812-7f7051a7a511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.092079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158ab65-e093-4806-9812-7f7051a7a511 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.097741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d2bbe-388a-45ed-98a4-9de592a6819d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.100636 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 137/283] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:24.101381 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158ab65-e093-4806-9812-7f7051a7a511 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.105975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e2fb-596c-4f4d-8182-5ff53fda13e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.106775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e2fb-596c-4f4d-8182-5ff53fda13e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.107054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e2fb-596c-4f4d-8182-5ff53fda13e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.107327 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e2fb-596c-4f4d-8182-5ff53fda13e5 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.115488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158ab65-e093-4806-9812-7f7051a7a511 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.120258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e53b5d-433b-48a2-8a7a-73fb4898e215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.120454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75e2fb-596c-4f4d-8182-5ff53fda13e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:24.120824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e53b5d-433b-48a2-8a7a-73fb4898e215 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.121105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e53b5d-433b-48a2-8a7a-73fb4898e215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.121377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e53b5d-433b-48a2-8a7a-73fb4898e215 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.127494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-8b75e2fb-596c-4f4d-8182-5ff53fda13e5 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 09:14:24.128986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 147/284] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:24.129581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e2fb-596c-4f4d-8182-5ff53fda13e5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.130583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e53b5d-433b-48a2-8a7a-73fb4898e215 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.136065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e53b5d-433b-48a2-8a7a-73fb4898e215 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.142360 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e2fb-596c-4f4d-8182-5ff53fda13e5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.145764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 138/285] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:24.146625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e53b5d-433b-48a2-8a7a-73fb4898e215 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.147142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0850a1-8a84-4e58-aa68-819f6592b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.148004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0850a1-8a84-4e58-aa68-819f6592b6bd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.148311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0850a1-8a84-4e58-aa68-819f6592b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.148582 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0850a1-8a84-4e58-aa68-819f6592b6bd admin admin] PATH_INFO: `/v3/users/a2c57e9579b24a089f74410efbaa032c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.155810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e53b5d-433b-48a2-8a7a-73fb4898e215 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.163366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146af14-36b0-462b-9d7d-15d99bf4d1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.164172 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146af14-36b0-462b-9d7d-15d99bf4d1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.164456 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146af14-36b0-462b-9d7d-15d99bf4d1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.164725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146af14-36b0-462b-9d7d-15d99bf4d1f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.165296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0850a1-8a84-4e58-aa68-819f6592b6bd admin admin] RBAC: Authorizing `identity:get_user(user_id=a2c57e9579b24a089f74410efbaa032c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.165465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146af14-36b0-462b-9d7d-15d99bf4d1f1 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:24.165759 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146af14-36b0-462b-9d7d-15d99bf4d1f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.167341 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146af14-36b0-462b-9d7d-15d99bf4d1f1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.167540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0850a1-8a84-4e58-aa68-819f6592b6bd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.169299 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 148/286] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:24 2022] GET /identity/v3/users/a2c57e9579b24a089f74410efbaa032c => generated 293 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:24.170092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0850a1-8a84-4e58-aa68-819f6592b6bd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.177308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 139/287] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:24.178234 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146af14-36b0-462b-9d7d-15d99bf4d1f1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.185219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0850a1-8a84-4e58-aa68-819f6592b6bd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.188646 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146af14-36b0-462b-9d7d-15d99bf4d1f1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.190383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c78153-5a5d-4914-962f-803c884ac499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.191252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c78153-5a5d-4914-962f-803c884ac499 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.191603 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c78153-5a5d-4914-962f-803c884ac499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.191820 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c78153-5a5d-4914-962f-803c884ac499 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.193040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c78153-5a5d-4914-962f-803c884ac499 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.193158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2544d3c-78d7-4b78-977d-4876b1ae2902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.193697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2544d3c-78d7-4b78-977d-4876b1ae2902 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.193978 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2544d3c-78d7-4b78-977d-4876b1ae2902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.194246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2544d3c-78d7-4b78-977d-4876b1ae2902 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.195068 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2544d3c-78d7-4b78-977d-4876b1ae2902 admin admin] RBAC: Adding query filter params (role.id=4184b38195d04c3a88c76c1255f7c7f7, user.id=a2c57e9579b24a089f74410efbaa032c, scope.system=all) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:24.195162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c78153-5a5d-4914-962f-803c884ac499 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.195374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2544d3c-78d7-4b78-977d-4876b1ae2902 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.197022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 149/288] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:24 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:24.197269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2544d3c-78d7-4b78-977d-4876b1ae2902 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.197623 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c78153-5a5d-4914-962f-803c884ac499 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.208153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 140/289] 10.222.0.90 () {56 vars in 1329 bytes} [Wed Feb 16 09:14:24 2022] GET /identity/v3/role_assignments?user.id=a2c57e9579b24a089f74410efbaa032c&scope.system=all&role.id=4184b38195d04c3a88c76c1255f7c7f7 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:24.208153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2544d3c-78d7-4b78-977d-4876b1ae2902 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.209327 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c78153-5a5d-4914-962f-803c884ac499 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.216592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ad230-815c-4956-bcbe-343b55e811d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.217597 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ad230-815c-4956-bcbe-343b55e811d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.217954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ad230-815c-4956-bcbe-343b55e811d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.218304 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ad230-815c-4956-bcbe-343b55e811d4 admin admin] PATH_INFO: `/v3/users/51d9fa6d5326486da9852ee45c7dc757` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.220151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ad230-815c-4956-bcbe-343b55e811d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=51d9fa6d5326486da9852ee45c7dc757)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.222496 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ad230-815c-4956-bcbe-343b55e811d4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.224519 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 150/290] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:24 2022] GET /identity/v3/users/51d9fa6d5326486da9852ee45c7dc757 => generated 297 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:24.224967 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2544d3c-78d7-4b78-977d-4876b1ae2902 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.230383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ad230-815c-4956-bcbe-343b55e811d4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.232236 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c274-82fb-4e61-bac2-9c561474deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.233203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c274-82fb-4e61-bac2-9c561474deb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.233692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c274-82fb-4e61-bac2-9c561474deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.234732 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2c274-82fb-4e61-bac2-9c561474deb4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.235917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2c274-82fb-4e61-bac2-9c561474deb4 admin admin] RBAC: Adding query filter params (role.id=4184b38195d04c3a88c76c1255f7c7f7, scope.project.id=ac4c94add81c409d847b103179d99972, user.id=99290bda8eaa4b8a9ba44d6234ee4c80) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:24.236554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2c274-82fb-4e61-bac2-9c561474deb4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.238797 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2c274-82fb-4e61-bac2-9c561474deb4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.241613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ad230-815c-4956-bcbe-343b55e811d4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.246349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed3c5e-5e73-41e6-bbd0-92a414c7b67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.247220 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed3c5e-5e73-41e6-bbd0-92a414c7b67b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.247494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed3c5e-5e73-41e6-bbd0-92a414c7b67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.247766 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed3c5e-5e73-41e6-bbd0-92a414c7b67b admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.248139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 141/291] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:24 2022] GET /identity/v3/role_assignments?user.id=99290bda8eaa4b8a9ba44d6234ee4c80&scope.project.id=ac4c94add81c409d847b103179d99972&role.id=4184b38195d04c3a88c76c1255f7c7f7 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:24.249116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed3c5e-5e73-41e6-bbd0-92a414c7b67b admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.251869 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed3c5e-5e73-41e6-bbd0-92a414c7b67b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.253944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 151/292] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:24 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:24.259814 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c274-82fb-4e61-bac2-9c561474deb4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:24.271009 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2c274-82fb-4e61-bac2-9c561474deb4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:24.276542 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94147ac-58be-4ecc-8019-fb5c56ce5733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:24.277476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94147ac-58be-4ecc-8019-fb5c56ce5733 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:24.277767 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94147ac-58be-4ecc-8019-fb5c56ce5733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:24.278042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94147ac-58be-4ecc-8019-fb5c56ce5733 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972/users/51d9fa6d5326486da9852ee45c7dc757/roles/da2cc800c7ad48d3a58d60617c9ed38e` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:24.282079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94147ac-58be-4ecc-8019-fb5c56ce5733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4c94add81c409d847b103179d99972, user_id=51d9fa6d5326486da9852ee45c7dc757, role_id=da2cc800c7ad48d3a58d60617c9ed38e)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:24.285085 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94147ac-58be-4ecc-8019-fb5c56ce5733 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:24.303379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 142/293] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:24 2022] PUT /identity/v3/projects/ac4c94add81c409d847b103179d99972/users/51d9fa6d5326486da9852ee45c7dc757/roles/da2cc800c7ad48d3a58d60617c9ed38e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:26.610818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210beb9d-7a21-4a91-a4b3-3725006e9eb2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.611352 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210beb9d-7a21-4a91-a4b3-3725006e9eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.611352 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210beb9d-7a21-4a91-a4b3-3725006e9eb2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.613490 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 152/294] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:26.619008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c9ddd-4f8f-4ae8-9b7f-ce62d3ba48cd None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.619442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c9ddd-4f8f-4ae8-9b7f-ce62d3ba48cd None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.619612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c9ddd-4f8f-4ae8-9b7f-ce62d3ba48cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.638578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-154c9ddd-4f8f-4ae8-9b7f-ce62d3ba48cd None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:26.640013 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-154c9ddd-4f8f-4ae8-9b7f-ce62d3ba48cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:26.659630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5124533-f9b0-4573-8639-14d33f0f9801 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.660258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5124533-f9b0-4573-8639-14d33f0f9801 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.660753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5124533-f9b0-4573-8639-14d33f0f9801 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.662585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 153/295] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:26.667821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98e148-fd3e-453a-b46f-9140480bdac6 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.668232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98e148-fd3e-453a-b46f-9140480bdac6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.668593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d98e148-fd3e-453a-b46f-9140480bdac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.686617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2d98e148-fd3e-453a-b46f-9140480bdac6 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:26.688604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2d98e148-fd3e-453a-b46f-9140480bdac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:26.707095 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 143/296] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:26.717569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b94d5-d79a-4946-976f-d01529a9c2cc None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.717855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b94d5-d79a-4946-976f-d01529a9c2cc None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.718136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b94d5-d79a-4946-976f-d01529a9c2cc None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.720895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 144/297] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:26.721923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06887f8-0a5c-4e07-b830-4295fdb72e8f None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.722200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06887f8-0a5c-4e07-b830-4295fdb72e8f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.722535 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06887f8-0a5c-4e07-b830-4295fdb72e8f None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.724112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 145/298] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:26.727901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8f94-bbbc-48b7-91db-0b79f25197d6 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.728433 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8f94-bbbc-48b7-91db-0b79f25197d6 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.728711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8f94-bbbc-48b7-91db-0b79f25197d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.745546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0fdd8f94-bbbc-48b7-91db-0b79f25197d6 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:26.746725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0fdd8f94-bbbc-48b7-91db-0b79f25197d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:26.751663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 154/299] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:26.753112 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22fb17-27ba-41a8-9765-8888d4ea5893 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.753409 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22fb17-27ba-41a8-9765-8888d4ea5893 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.753685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22fb17-27ba-41a8-9765-8888d4ea5893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.757323 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 146/300] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:26.758105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd8f94-bbbc-48b7-91db-0b79f25197d6 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.769352 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd8f94-bbbc-48b7-91db-0b79f25197d6 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.773804 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845c33c-9511-4289-9dd3-9283b5e5196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.775334 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845c33c-9511-4289-9dd3-9283b5e5196b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.775628 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845c33c-9511-4289-9dd3-9283b5e5196b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.775907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845c33c-9511-4289-9dd3-9283b5e5196b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.780544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-bd22fb17-27ba-41a8-9765-8888d4ea5893 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:26.782616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bd22fb17-27ba-41a8-9765-8888d4ea5893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:26.787230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845c33c-9511-4289-9dd3-9283b5e5196b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:26.790044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 155/301] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:26.790810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22fb17-27ba-41a8-9765-8888d4ea5893 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.794455 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-9845c33c-9511-4289-9dd3-9283b5e5196b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:26.795742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 147/302] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:26.797353 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845c33c-9511-4289-9dd3-9283b5e5196b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.800260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22fb17-27ba-41a8-9765-8888d4ea5893 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.804838 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc247f-ec76-4bc8-be31-bfa42af74218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.805598 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc247f-ec76-4bc8-be31-bfa42af74218 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.805876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc247f-ec76-4bc8-be31-bfa42af74218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.806148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc247f-ec76-4bc8-be31-bfa42af74218 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.807218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845c33c-9511-4289-9dd3-9283b5e5196b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.811699 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529b63e-09b9-4aec-81dd-325c8392edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.813303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529b63e-09b9-4aec-81dd-325c8392edb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.813836 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529b63e-09b9-4aec-81dd-325c8392edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.814430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529b63e-09b9-4aec-81dd-325c8392edb1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.815779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529b63e-09b9-4aec-81dd-325c8392edb1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:26.817499 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529b63e-09b9-4aec-81dd-325c8392edb1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:26.817728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dc247f-ec76-4bc8-be31-bfa42af74218 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:26.819089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 148/303] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:26.819891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529b63e-09b9-4aec-81dd-325c8392edb1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.824834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-29dc247f-ec76-4bc8-be31-bfa42af74218 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 09:14:26.826013 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 156/304] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:26.826773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc247f-ec76-4bc8-be31-bfa42af74218 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.831289 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529b63e-09b9-4aec-81dd-325c8392edb1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.835529 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15017d4f-69e5-4046-bde1-906ab63b7a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.836182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15017d4f-69e5-4046-bde1-906ab63b7a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.836458 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15017d4f-69e5-4046-bde1-906ab63b7a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.836724 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15017d4f-69e5-4046-bde1-906ab63b7a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.837446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15017d4f-69e5-4046-bde1-906ab63b7a15 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:26.837700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc247f-ec76-4bc8-be31-bfa42af74218 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.837800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15017d4f-69e5-4046-bde1-906ab63b7a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:26.839271 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15017d4f-69e5-4046-bde1-906ab63b7a15 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:26.842142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7255981-4b5d-4b07-b9d1-5105ce5100ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.842932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7255981-4b5d-4b07-b9d1-5105ce5100ab admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.843275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7255981-4b5d-4b07-b9d1-5105ce5100ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.843709 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7255981-4b5d-4b07-b9d1-5105ce5100ab admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.847744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 149/305] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:26.848558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15017d4f-69e5-4046-bde1-906ab63b7a15 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.857622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15017d4f-69e5-4046-bde1-906ab63b7a15 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.858033 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7255981-4b5d-4b07-b9d1-5105ce5100ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:26.862098 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86326a1e-f23a-4068-a3f8-da61a7a2fa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.862652 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86326a1e-f23a-4068-a3f8-da61a7a2fa91 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.862929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86326a1e-f23a-4068-a3f8-da61a7a2fa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.863201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86326a1e-f23a-4068-a3f8-da61a7a2fa91 admin admin] PATH_INFO: `/v3/groups` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.863864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86326a1e-f23a-4068-a3f8-da61a7a2fa91 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:26.864881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-86326a1e-f23a-4068-a3f8-da61a7a2fa91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:26.864881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:14:26.864881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:14:26.865371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-d7255981-4b5d-4b07-b9d1-5105ce5100ab admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 09:14:26.866041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86326a1e-f23a-4068-a3f8-da61a7a2fa91 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:26.866528 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 157/306] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:26.867270 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7255981-4b5d-4b07-b9d1-5105ce5100ab admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.877187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7255981-4b5d-4b07-b9d1-5105ce5100ab admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.896052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 150/307] 10.222.0.90 () {60 vars in 1155 bytes} [Wed Feb 16 09:14:26 2022] POST /identity/v3/groups => generated 229 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:26.896266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9b9bf-ee2e-4c33-a09a-5603773bd821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.896376 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86326a1e-f23a-4068-a3f8-da61a7a2fa91 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.896463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9b9bf-ee2e-4c33-a09a-5603773bd821 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.896463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9b9bf-ee2e-4c33-a09a-5603773bd821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.896463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9b9bf-ee2e-4c33-a09a-5603773bd821 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.896463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9b9bf-ee2e-4c33-a09a-5603773bd821 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:26.896463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9b9bf-ee2e-4c33-a09a-5603773bd821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:26.896463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9b9bf-ee2e-4c33-a09a-5603773bd821 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:26.896880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86326a1e-f23a-4068-a3f8-da61a7a2fa91 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.896956 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 158/308] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:26.897843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9b9bf-ee2e-4c33-a09a-5603773bd821 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.903100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2641087-f7c0-4b4f-99f5-facdbfe50f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.904001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2641087-f7c0-4b4f-99f5-facdbfe50f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.904313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2641087-f7c0-4b4f-99f5-facdbfe50f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.904590 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2641087-f7c0-4b4f-99f5-facdbfe50f72 admin admin] PATH_INFO: `/v3/users/a2c57e9579b24a089f74410efbaa032c` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.905893 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2641087-f7c0-4b4f-99f5-facdbfe50f72 admin admin] RBAC: Authorizing `identity:get_user(user_id=a2c57e9579b24a089f74410efbaa032c)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:26.908916 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2641087-f7c0-4b4f-99f5-facdbfe50f72 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:26.909302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9b9bf-ee2e-4c33-a09a-5603773bd821 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.915458 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 151/309] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:26 2022] GET /identity/v3/users/a2c57e9579b24a089f74410efbaa032c => generated 293 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:26.915458 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2641087-f7c0-4b4f-99f5-facdbfe50f72 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.919248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58f3c0-c960-4063-a0c4-11c2e618bed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.919956 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58f3c0-c960-4063-a0c4-11c2e618bed9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.920281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58f3c0-c960-4063-a0c4-11c2e618bed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.920610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58f3c0-c960-4063-a0c4-11c2e618bed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.921373 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58f3c0-c960-4063-a0c4-11c2e618bed9 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:26.921711 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58f3c0-c960-4063-a0c4-11c2e618bed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:26.924056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58f3c0-c960-4063-a0c4-11c2e618bed9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:26.926048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2641087-f7c0-4b4f-99f5-facdbfe50f72 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.930575 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12328472-cec8-4295-87ea-44fe35e2d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.931447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12328472-cec8-4295-87ea-44fe35e2d078 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.931731 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12328472-cec8-4295-87ea-44fe35e2d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.932005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12328472-cec8-4295-87ea-44fe35e2d078 admin admin] PATH_INFO: `/v3/users/1971e8849e8f4db59b38d67b6eed4aa4` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.938169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 159/310] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:26.938169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58f3c0-c960-4063-a0c4-11c2e618bed9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.949375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58f3c0-c960-4063-a0c4-11c2e618bed9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.952329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12328472-cec8-4295-87ea-44fe35e2d078 admin admin] RBAC: Authorizing `identity:get_user(user_id=1971e8849e8f4db59b38d67b6eed4aa4)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:26.955186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12328472-cec8-4295-87ea-44fe35e2d078 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:26.956084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba061897-a293-4e20-925f-4cfad53bf673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.957198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba061897-a293-4e20-925f-4cfad53bf673 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.957303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 152/311] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:26 2022] GET /identity/v3/users/1971e8849e8f4db59b38d67b6eed4aa4 => generated 293 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:26.957375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba061897-a293-4e20-925f-4cfad53bf673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.957566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba061897-a293-4e20-925f-4cfad53bf673 admin admin] PATH_INFO: `/v3/system/users/a2c57e9579b24a089f74410efbaa032c/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.959034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba061897-a293-4e20-925f-4cfad53bf673 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a2c57e9579b24a089f74410efbaa032c, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:26.960103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-ba061897-a293-4e20-925f-4cfad53bf673 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:26.960103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:14:26.960103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:14:26.960991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba061897-a293-4e20-925f-4cfad53bf673 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:26.962841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12328472-cec8-4295-87ea-44fe35e2d078 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.972084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 160/312] 10.222.0.90 () {58 vars in 1355 bytes} [Wed Feb 16 09:14:26 2022] PUT /identity/v3/system/users/a2c57e9579b24a089f74410efbaa032c/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:26.980311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba061897-a293-4e20-925f-4cfad53bf673 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:26.983750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12328472-cec8-4295-87ea-44fe35e2d078 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.984977 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba061897-a293-4e20-925f-4cfad53bf673 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:26.989184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96186eb9-3dce-489f-a08e-d6c2c72d36d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.990126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96186eb9-3dce-489f-a08e-d6c2c72d36d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.990258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413a0c4-9c37-4dd8-94bf-0354bb7d96c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:26.990436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96186eb9-3dce-489f-a08e-d6c2c72d36d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.991037 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96186eb9-3dce-489f-a08e-d6c2c72d36d8 admin admin] PATH_INFO: `/v3/users/51d9fa6d5326486da9852ee45c7dc757` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.991138 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413a0c4-9c37-4dd8-94bf-0354bb7d96c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:26.991221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413a0c4-9c37-4dd8-94bf-0354bb7d96c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:26.995468 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413a0c4-9c37-4dd8-94bf-0354bb7d96c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:26.995664 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96186eb9-3dce-489f-a08e-d6c2c72d36d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=51d9fa6d5326486da9852ee45c7dc757)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:26.995741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413a0c4-9c37-4dd8-94bf-0354bb7d96c8 admin admin] RBAC: Adding query filter params (role.id=da2cc800c7ad48d3a58d60617c9ed38e, user.id=1971e8849e8f4db59b38d67b6eed4aa4, scope.system=all) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:26.995741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413a0c4-9c37-4dd8-94bf-0354bb7d96c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:26.995896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96186eb9-3dce-489f-a08e-d6c2c72d36d8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:26.995973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413a0c4-9c37-4dd8-94bf-0354bb7d96c8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:26.996060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 153/313] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:26 2022] GET /identity/v3/users/51d9fa6d5326486da9852ee45c7dc757 => generated 297 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:27.003409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96186eb9-3dce-489f-a08e-d6c2c72d36d8 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:27.004230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 161/314] 10.222.0.90 () {56 vars in 1329 bytes} [Wed Feb 16 09:14:26 2022] GET /identity/v3/role_assignments?user.id=1971e8849e8f4db59b38d67b6eed4aa4&scope.system=all&role.id=da2cc800c7ad48d3a58d60617c9ed38e => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:27.026290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96186eb9-3dce-489f-a08e-d6c2c72d36d8 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:27.031931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81864abf-04bc-4b4f-9bea-c21047b1f309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:27.033128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81864abf-04bc-4b4f-9bea-c21047b1f309 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:27.033616 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81864abf-04bc-4b4f-9bea-c21047b1f309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:27.034117 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81864abf-04bc-4b4f-9bea-c21047b1f309 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:27.044001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81864abf-04bc-4b4f-9bea-c21047b1f309 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:27.046428 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81864abf-04bc-4b4f-9bea-c21047b1f309 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:27.058620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 154/315] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:27.066465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413a0c4-9c37-4dd8-94bf-0354bb7d96c8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:27.083703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413a0c4-9c37-4dd8-94bf-0354bb7d96c8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:27.089370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb061e5-8a10-4638-8251-ca256e69f13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:27.090268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb061e5-8a10-4638-8251-ca256e69f13e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:27.090549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb061e5-8a10-4638-8251-ca256e69f13e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:27.090815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb061e5-8a10-4638-8251-ca256e69f13e admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:27.092197 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb061e5-8a10-4638-8251-ca256e69f13e admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:27.095134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb061e5-8a10-4638-8251-ca256e69f13e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:27.097243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 162/316] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:27 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:27.103513 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81864abf-04bc-4b4f-9bea-c21047b1f309 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:27.114194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81864abf-04bc-4b4f-9bea-c21047b1f309 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:27.118901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239cb49-049f-40fb-afe9-f76b9b8558c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:27.119584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239cb49-049f-40fb-afe9-f76b9b8558c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:27.119865 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239cb49-049f-40fb-afe9-f76b9b8558c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:27.120192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239cb49-049f-40fb-afe9-f76b9b8558c4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:27.121058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239cb49-049f-40fb-afe9-f76b9b8558c4 admin admin] RBAC: Adding query filter params (role.id=da2cc800c7ad48d3a58d60617c9ed38e, scope.project.id=ac4c94add81c409d847b103179d99972, user.id=51d9fa6d5326486da9852ee45c7dc757) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:27.121368 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239cb49-049f-40fb-afe9-f76b9b8558c4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:27.123412 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239cb49-049f-40fb-afe9-f76b9b8558c4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:27.131259 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 155/317] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:27 2022] GET /identity/v3/role_assignments?user.id=51d9fa6d5326486da9852ee45c7dc757&scope.project.id=ac4c94add81c409d847b103179d99972&role.id=da2cc800c7ad48d3a58d60617c9ed38e => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:29.279484 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848404e-4b40-4cc7-830e-cd78e9b6d0b2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.279981 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848404e-4b40-4cc7-830e-cd78e9b6d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.280079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848404e-4b40-4cc7-830e-cd78e9b6d0b2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.282794 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 163/318] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:29.287824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef081df-600e-4d95-a20c-bd783baacf8d None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.288255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef081df-600e-4d95-a20c-bd783baacf8d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.288434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef081df-600e-4d95-a20c-bd783baacf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.306466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-fef081df-600e-4d95-a20c-bd783baacf8d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:29.307624 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-fef081df-600e-4d95-a20c-bd783baacf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:29.315087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 156/319] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:29.337788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848404e-4b40-4cc7-830e-cd78e9b6d0b2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:29.350608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848404e-4b40-4cc7-830e-cd78e9b6d0b2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:29.354712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458d952-7ca9-4f2b-8205-49d69b9b689f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:29.355475 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458d952-7ca9-4f2b-8205-49d69b9b689f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.355755 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458d952-7ca9-4f2b-8205-49d69b9b689f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.356016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458d952-7ca9-4f2b-8205-49d69b9b689f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.357194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458d952-7ca9-4f2b-8205-49d69b9b689f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:29.358882 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458d952-7ca9-4f2b-8205-49d69b9b689f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:29.361430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 164/320] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:29.362307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f8baf-7843-435f-8911-57575b24037e None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.362599 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f8baf-7843-435f-8911-57575b24037e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.362880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f8baf-7843-435f-8911-57575b24037e None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.364772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 157/321] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:29.366405 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458d952-7ca9-4f2b-8205-49d69b9b689f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:29.369416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31884295-abfb-4241-a661-3915d3226744 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.369688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31884295-abfb-4241-a661-3915d3226744 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.369962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31884295-abfb-4241-a661-3915d3226744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.375975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458d952-7ca9-4f2b-8205-49d69b9b689f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:29.380256 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d442a-5d86-4ee5-9224-516da00e1f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:29.380902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d442a-5d86-4ee5-9224-516da00e1f87 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.381280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d442a-5d86-4ee5-9224-516da00e1f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.381553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d442a-5d86-4ee5-9224-516da00e1f87 admin admin] PATH_INFO: `/v3/groups` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.382240 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d442a-5d86-4ee5-9224-516da00e1f87 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:29.383245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-df8d442a-5d86-4ee5-9224-516da00e1f87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:29.383245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:14:29.383245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:14:29.384440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d442a-5d86-4ee5-9224-516da00e1f87 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:29.388793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-31884295-abfb-4241-a661-3915d3226744 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:29.390251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-31884295-abfb-4241-a661-3915d3226744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:29.398920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 165/322] 10.222.0.90 () {60 vars in 1155 bytes} [Wed Feb 16 09:14:29 2022] POST /identity/v3/groups => generated 226 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:29.399051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 158/323] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:29.405720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390642b-27fe-453f-b32b-12a7b4bb3114 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.406860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390642b-27fe-453f-b32b-12a7b4bb3114 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.407124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390642b-27fe-453f-b32b-12a7b4bb3114 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.409250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 166/324] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:29.415134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8308d02-2111-46b1-a6c1-5b45ea97cab9 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.415489 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8308d02-2111-46b1-a6c1-5b45ea97cab9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.415834 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8308d02-2111-46b1-a6c1-5b45ea97cab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.424294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390642b-27fe-453f-b32b-12a7b4bb3114 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:29.436546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-c8308d02-2111-46b1-a6c1-5b45ea97cab9 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:29.436749 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390642b-27fe-453f-b32b-12a7b4bb3114 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:29.439190 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c8308d02-2111-46b1-a6c1-5b45ea97cab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:29.441615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13156c2f-c5e3-4003-80b6-49761b8d8968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:29.442415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13156c2f-c5e3-4003-80b6-49761b8d8968 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.442695 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13156c2f-c5e3-4003-80b6-49761b8d8968 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.442969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13156c2f-c5e3-4003-80b6-49761b8d8968 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.449401 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 159/325] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:29.456422 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13156c2f-c5e3-4003-80b6-49761b8d8968 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:29.463656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-13156c2f-c5e3-4003-80b6-49761b8d8968 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:29.465205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 167/326] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:29.471901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8308d02-2111-46b1-a6c1-5b45ea97cab9 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:29.474154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13156c2f-c5e3-4003-80b6-49761b8d8968 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:29.482593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8308d02-2111-46b1-a6c1-5b45ea97cab9 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:29.485971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13156c2f-c5e3-4003-80b6-49761b8d8968 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:29.488871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e50594-b454-4df0-a68e-fdade72234e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:29.489548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e50594-b454-4df0-a68e-fdade72234e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.489829 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e50594-b454-4df0-a68e-fdade72234e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.490203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e50594-b454-4df0-a68e-fdade72234e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.490592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe9dff-a6dd-4590-9d9e-5e8ff659be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:29.491018 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e50594-b454-4df0-a68e-fdade72234e3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:29.491329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e50594-b454-4df0-a68e-fdade72234e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:29.491434 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe9dff-a6dd-4590-9d9e-5e8ff659be20 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.491650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe9dff-a6dd-4590-9d9e-5e8ff659be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.491926 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe9dff-a6dd-4590-9d9e-5e8ff659be20 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.493192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e50594-b454-4df0-a68e-fdade72234e3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:29.504516 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe9dff-a6dd-4590-9d9e-5e8ff659be20 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:29.505382 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 160/327] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:29.510796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e50594-b454-4df0-a68e-fdade72234e3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:29.511525 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a2fe9dff-a6dd-4590-9d9e-5e8ff659be20 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 09:14:29.518029 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 168/328] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:29.519550 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe9dff-a6dd-4590-9d9e-5e8ff659be20 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:29.521929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e50594-b454-4df0-a68e-fdade72234e3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:29.527511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd83b5-cff3-4d45-8cc2-e53e8dc9cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:29.528432 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd83b5-cff3-4d45-8cc2-e53e8dc9cfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.528715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd83b5-cff3-4d45-8cc2-e53e8dc9cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.528986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd83b5-cff3-4d45-8cc2-e53e8dc9cfe2 admin admin] PATH_INFO: `/v3/users/a2c57e9579b24a089f74410efbaa032c` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.529564 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe9dff-a6dd-4590-9d9e-5e8ff659be20 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:29.530500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd83b5-cff3-4d45-8cc2-e53e8dc9cfe2 admin admin] RBAC: Authorizing `identity:get_user(user_id=a2c57e9579b24a089f74410efbaa032c)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:29.533493 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd83b5-cff3-4d45-8cc2-e53e8dc9cfe2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:29.534372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b10457-75fb-4c60-94bd-7034fee98f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:29.535042 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b10457-75fb-4c60-94bd-7034fee98f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.535325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b10457-75fb-4c60-94bd-7034fee98f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.535603 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b10457-75fb-4c60-94bd-7034fee98f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.536397 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b10457-75fb-4c60-94bd-7034fee98f94 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:29.536706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b10457-75fb-4c60-94bd-7034fee98f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:29.538372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b10457-75fb-4c60-94bd-7034fee98f94 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:29.540216 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 161/329] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:29 2022] GET /identity/v3/users/a2c57e9579b24a089f74410efbaa032c => generated 293 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:29.541131 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd83b5-cff3-4d45-8cc2-e53e8dc9cfe2 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:29.551593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 169/330] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:29.552134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd83b5-cff3-4d45-8cc2-e53e8dc9cfe2 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:29.556757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c363d6-0231-49b7-ac9b-fb94300d022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:29.557251 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b10457-75fb-4c60-94bd-7034fee98f94 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:29.557409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c363d6-0231-49b7-ac9b-fb94300d022f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.557717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c363d6-0231-49b7-ac9b-fb94300d022f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.557987 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c363d6-0231-49b7-ac9b-fb94300d022f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.558815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c363d6-0231-49b7-ac9b-fb94300d022f admin admin] RBAC: Adding query filter params (role.id=4184b38195d04c3a88c76c1255f7c7f7, user.id=a2c57e9579b24a089f74410efbaa032c, scope.system=all) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:29.559118 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c363d6-0231-49b7-ac9b-fb94300d022f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:29.561030 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c363d6-0231-49b7-ac9b-fb94300d022f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:29.570199 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b10457-75fb-4c60-94bd-7034fee98f94 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:29.576016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65debc84-7e13-4c71-9b9d-f111a569fe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:29.577094 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65debc84-7e13-4c71-9b9d-f111a569fe9f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.577376 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65debc84-7e13-4c71-9b9d-f111a569fe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.577652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65debc84-7e13-4c71-9b9d-f111a569fe9f admin admin] PATH_INFO: `/v3/users/1971e8849e8f4db59b38d67b6eed4aa4` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.578028 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 162/331] 10.222.0.90 () {56 vars in 1329 bytes} [Wed Feb 16 09:14:29 2022] GET /identity/v3/role_assignments?user.id=a2c57e9579b24a089f74410efbaa032c&scope.system=all&role.id=4184b38195d04c3a88c76c1255f7c7f7 => generated 510 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:29.579194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65debc84-7e13-4c71-9b9d-f111a569fe9f admin admin] RBAC: Authorizing `identity:get_user(user_id=1971e8849e8f4db59b38d67b6eed4aa4)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:29.581382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65debc84-7e13-4c71-9b9d-f111a569fe9f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:29.583049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 170/332] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:29 2022] GET /identity/v3/users/1971e8849e8f4db59b38d67b6eed4aa4 => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:29.588970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c363d6-0231-49b7-ac9b-fb94300d022f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:29.599773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c363d6-0231-49b7-ac9b-fb94300d022f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:29.604423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2dad7-f183-45b6-9288-fd292781d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:29.605302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2dad7-f183-45b6-9288-fd292781d43e admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:29.605578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2dad7-f183-45b6-9288-fd292781d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:29.605846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2dad7-f183-45b6-9288-fd292781d43e admin admin] PATH_INFO: `/v3/system/users/1971e8849e8f4db59b38d67b6eed4aa4/roles/da2cc800c7ad48d3a58d60617c9ed38e` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:29.607396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2dad7-f183-45b6-9288-fd292781d43e admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1971e8849e8f4db59b38d67b6eed4aa4, role_id=da2cc800c7ad48d3a58d60617c9ed38e)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:29.608563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-56d2dad7-f183-45b6-9288-fd292781d43e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:29.608563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:14:29.608563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:14:29.610470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2dad7-f183-45b6-9288-fd292781d43e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:29.620119 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 163/333] 10.222.0.90 () {58 vars in 1355 bytes} [Wed Feb 16 09:14:29 2022] PUT /identity/v3/system/users/1971e8849e8f4db59b38d67b6eed4aa4/roles/da2cc800c7ad48d3a58d60617c9ed38e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:32.321782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359f628-3249-40ed-a0f7-95ecb9d530ae None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.322295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359f628-3249-40ed-a0f7-95ecb9d530ae None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.322373 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359f628-3249-40ed-a0f7-95ecb9d530ae None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.324110 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 171/334] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:32.342402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689b490-07d5-40d0-afa8-1544c49b465a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.343858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689b490-07d5-40d0-afa8-1544c49b465a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.345102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689b490-07d5-40d0-afa8-1544c49b465a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.369822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-6689b490-07d5-40d0-afa8-1544c49b465a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:32.371336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6689b490-07d5-40d0-afa8-1544c49b465a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:32.384426 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 164/335] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:32.429249 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359f628-3249-40ed-a0f7-95ecb9d530ae None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.443089 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359f628-3249-40ed-a0f7-95ecb9d530ae None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.448091 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ac06c-b864-4eb5-a09f-8a637f9ac0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.449234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ac06c-b864-4eb5-a09f-8a637f9ac0ef admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.449716 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ac06c-b864-4eb5-a09f-8a637f9ac0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.450213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ac06c-b864-4eb5-a09f-8a637f9ac0ef admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.468713 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ac06c-b864-4eb5-a09f-8a637f9ac0ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:32.475911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-8b3ac06c-b864-4eb5-a09f-8a637f9ac0ef admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:32.478464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 172/336] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:32.483512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689b490-07d5-40d0-afa8-1544c49b465a None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.501093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e62e38-da12-49b3-9670-df8e72511df7 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.501542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e62e38-da12-49b3-9670-df8e72511df7 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.501832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e62e38-da12-49b3-9670-df8e72511df7 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.502714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689b490-07d5-40d0-afa8-1544c49b465a None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.504132 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 173/337] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:32.509544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9834a5-d5b3-4d52-9333-bf17d5fb8665 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.509834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9834a5-d5b3-4d52-9333-bf17d5fb8665 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.510108 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9834a5-d5b3-4d52-9333-bf17d5fb8665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.511061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864887cd-4d4e-41cb-a824-c2586e63e833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.512134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864887cd-4d4e-41cb-a824-c2586e63e833 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.512645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864887cd-4d4e-41cb-a824-c2586e63e833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.513119 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864887cd-4d4e-41cb-a824-c2586e63e833 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.514087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864887cd-4d4e-41cb-a824-c2586e63e833 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:32.514860 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864887cd-4d4e-41cb-a824-c2586e63e833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:32.517138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864887cd-4d4e-41cb-a824-c2586e63e833 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:32.532285 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 165/338] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:32.534513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-de9834a5-d5b3-4d52-9333-bf17d5fb8665 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:32.535784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-de9834a5-d5b3-4d52-9333-bf17d5fb8665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:32.542250 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864887cd-4d4e-41cb-a824-c2586e63e833 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.550712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 174/339] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:32.553980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864887cd-4d4e-41cb-a824-c2586e63e833 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.569621 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3b31a-85b9-4d13-8fde-687c9591ad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.570593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b31a-85b9-4d13-8fde-687c9591ad75 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.571075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b31a-85b9-4d13-8fde-687c9591ad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.571548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b31a-85b9-4d13-8fde-687c9591ad75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.583649 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3b31a-85b9-4d13-8fde-687c9591ad75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:32.585727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3b31a-85b9-4d13-8fde-687c9591ad75 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:32.592469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9834a5-d5b3-4d52-9333-bf17d5fb8665 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.595245 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 166/340] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 09:14:32.604042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3b31a-85b9-4d13-8fde-687c9591ad75 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.607425 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9834a5-d5b3-4d52-9333-bf17d5fb8665 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.610224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3b31a-85b9-4d13-8fde-687c9591ad75 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.622273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31147948-89e2-4328-935a-fe4182a959a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.623158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31147948-89e2-4328-935a-fe4182a959a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.623425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31147948-89e2-4328-935a-fe4182a959a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.623539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5ddb0-0236-4264-92dc-8f4924e68a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.623690 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31147948-89e2-4328-935a-fe4182a959a6 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.624721 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5ddb0-0236-4264-92dc-8f4924e68a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.625871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31147948-89e2-4328-935a-fe4182a959a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:32.626214 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5ddb0-0236-4264-92dc-8f4924e68a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.626688 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5ddb0-0236-4264-92dc-8f4924e68a21 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.632040 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31147948-89e2-4328-935a-fe4182a959a6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:32.632040 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 167/341] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:32.635294 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31147948-89e2-4328-935a-fe4182a959a6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.650917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31147948-89e2-4328-935a-fe4182a959a6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.661027 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5ddb0-0236-4264-92dc-8f4924e68a21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:32.667963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-b9b5ddb0-0236-4264-92dc-8f4924e68a21 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:32.675563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41df3b6-a5b8-4fa6-ace4-24f8744c183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.676454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41df3b6-a5b8-4fa6-ace4-24f8744c183d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.676739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41df3b6-a5b8-4fa6-ace4-24f8744c183d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.677017 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41df3b6-a5b8-4fa6-ace4-24f8744c183d admin admin] PATH_INFO: `/v3/groups/acf2887dc79743b798eda4b7d8d7e948` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.680697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 175/342] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:32.685127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41df3b6-a5b8-4fa6-ace4-24f8744c183d admin admin] RBAC: Authorizing `identity:get_group(group_id=acf2887dc79743b798eda4b7d8d7e948)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:32.685964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5ddb0-0236-4264-92dc-8f4924e68a21 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.692230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-d41df3b6-a5b8-4fa6-ace4-24f8744c183d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:32.692230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:14:32.692230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:14:32.693443 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41df3b6-a5b8-4fa6-ace4-24f8744c183d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:32.695307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 168/343] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/groups/acf2887dc79743b798eda4b7d8d7e948 => generated 226 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:32.701099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41df3b6-a5b8-4fa6-ace4-24f8744c183d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.709262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5ddb0-0236-4264-92dc-8f4924e68a21 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.716619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd4097-b7b1-4ed4-a909-494b709a5350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.717282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd4097-b7b1-4ed4-a909-494b709a5350 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.717564 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd4097-b7b1-4ed4-a909-494b709a5350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.717854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd4097-b7b1-4ed4-a909-494b709a5350 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.718833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd4097-b7b1-4ed4-a909-494b709a5350 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:32.719215 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd4097-b7b1-4ed4-a909-494b709a5350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:32.723313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41df3b6-a5b8-4fa6-ace4-24f8744c183d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.724765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd4097-b7b1-4ed4-a909-494b709a5350 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:32.734712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539eb5d7-8d19-4bad-8e3c-5de02cdab5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.735435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eb5d7-8d19-4bad-8e3c-5de02cdab5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.735769 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eb5d7-8d19-4bad-8e3c-5de02cdab5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.736066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539eb5d7-8d19-4bad-8e3c-5de02cdab5d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.736902 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539eb5d7-8d19-4bad-8e3c-5de02cdab5d7 admin admin] RBAC: Adding query filter params (group.id=acf2887dc79743b798eda4b7d8d7e948, role.id=4184b38195d04c3a88c76c1255f7c7f7, scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:32.737212 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539eb5d7-8d19-4bad-8e3c-5de02cdab5d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:32.739080 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539eb5d7-8d19-4bad-8e3c-5de02cdab5d7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:32.744422 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 176/344] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:32.751602 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd4097-b7b1-4ed4-a909-494b709a5350 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.752858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 169/345] 10.222.0.90 () {56 vars in 1397 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/role_assignments?group.id=acf2887dc79743b798eda4b7d8d7e948&scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba&role.id=4184b38195d04c3a88c76c1255f7c7f7 => generated 260 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:32.766417 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd4097-b7b1-4ed4-a909-494b709a5350 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.775392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e18fef-4195-4c0f-9ce8-d2c6760dd72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.776134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e18fef-4195-4c0f-9ce8-d2c6760dd72f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.776423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e18fef-4195-4c0f-9ce8-d2c6760dd72f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.776701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e18fef-4195-4c0f-9ce8-d2c6760dd72f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.787758 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e18fef-4195-4c0f-9ce8-d2c6760dd72f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:32.789557 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e18fef-4195-4c0f-9ce8-d2c6760dd72f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:32.803050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 177/346] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:32.808407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539eb5d7-8d19-4bad-8e3c-5de02cdab5d7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.819187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539eb5d7-8d19-4bad-8e3c-5de02cdab5d7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.823761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a924-8457-40e6-988d-930ca3043540 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.824149 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a924-8457-40e6-988d-930ca3043540 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.824432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14a924-8457-40e6-988d-930ca3043540 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.826219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 178/347] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:32.832528 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c091b-46ae-4bcd-b2bd-a9d98173ecc5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.832833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c091b-46ae-4bcd-b2bd-a9d98173ecc5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.833073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c091b-46ae-4bcd-b2bd-a9d98173ecc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.834449 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3d27f-bd50-443d-874c-cb664af31cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.835256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3d27f-bd50-443d-874c-cb664af31cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.835531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3d27f-bd50-443d-874c-cb664af31cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.835806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3d27f-bd50-443d-874c-cb664af31cf7 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.838740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3d27f-bd50-443d-874c-cb664af31cf7 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:32.840852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3d27f-bd50-443d-874c-cb664af31cf7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:32.846225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 170/348] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:32.854665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3d27f-bd50-443d-874c-cb664af31cf7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.868863 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-784c091b-46ae-4bcd-b2bd-a9d98173ecc5 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:32.870092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-784c091b-46ae-4bcd-b2bd-a9d98173ecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:32.876342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3d27f-bd50-443d-874c-cb664af31cf7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.885981 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae34e08-8b6f-419d-8baa-32a21d4460eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.886850 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae34e08-8b6f-419d-8baa-32a21d4460eb admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.887130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae34e08-8b6f-419d-8baa-32a21d4460eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.887404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae34e08-8b6f-419d-8baa-32a21d4460eb admin admin] PATH_INFO: `/v3/groups/acf2887dc79743b798eda4b7d8d7e948` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.889341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 179/349] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 16 09:14:32.890321 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae34e08-8b6f-419d-8baa-32a21d4460eb admin admin] RBAC: Authorizing `identity:get_group(group_id=acf2887dc79743b798eda4b7d8d7e948)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:32.892293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae34e08-8b6f-419d-8baa-32a21d4460eb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:32.894189 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 171/350] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/groups/acf2887dc79743b798eda4b7d8d7e948 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:32.899795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c091b-46ae-4bcd-b2bd-a9d98173ecc5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.913346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c091b-46ae-4bcd-b2bd-a9d98173ecc5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.919730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae34e08-8b6f-419d-8baa-32a21d4460eb admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.932144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae34e08-8b6f-419d-8baa-32a21d4460eb admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:32.933392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92bd58-0ef5-4bee-964b-12264fb48c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.934056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92bd58-0ef5-4bee-964b-12264fb48c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.934338 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92bd58-0ef5-4bee-964b-12264fb48c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.934612 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92bd58-0ef5-4bee-964b-12264fb48c11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.935454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92bd58-0ef5-4bee-964b-12264fb48c11 admin admin] RBAC: Adding query filter params (group.id=acf2887dc79743b798eda4b7d8d7e948, role.id=4184b38195d04c3a88c76c1255f7c7f7, scope.project.id=ac4c94add81c409d847b103179d99972) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:32.935763 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92bd58-0ef5-4bee-964b-12264fb48c11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:32.938225 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92bd58-0ef5-4bee-964b-12264fb48c11 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:32.947793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ee155-b9c4-4c23-b187-3fd845675fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:32.948651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ee155-b9c4-4c23-b187-3fd845675fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:32.948936 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ee155-b9c4-4c23-b187-3fd845675fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:32.949215 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ee155-b9c4-4c23-b187-3fd845675fd9 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:32.955317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 180/351] 10.222.0.90 () {56 vars in 1397 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/role_assignments?group.id=acf2887dc79743b798eda4b7d8d7e948&scope.project.id=ac4c94add81c409d847b103179d99972&role.id=4184b38195d04c3a88c76c1255f7c7f7 => generated 260 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:32.965242 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ee155-b9c4-4c23-b187-3fd845675fd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:32.973223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-132ee155-b9c4-4c23-b187-3fd845675fd9 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 09:14:32.974482 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 172/352] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:32.980692 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92bd58-0ef5-4bee-964b-12264fb48c11 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:32.991619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92bd58-0ef5-4bee-964b-12264fb48c11 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:33.003010 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d214aa7-47ef-466e-9c70-06c889e8d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:33.003687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d214aa7-47ef-466e-9c70-06c889e8d5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:33.004054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d214aa7-47ef-466e-9c70-06c889e8d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:33.004384 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d214aa7-47ef-466e-9c70-06c889e8d5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:33.005222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d214aa7-47ef-466e-9c70-06c889e8d5f0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:33.005595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d214aa7-47ef-466e-9c70-06c889e8d5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:33.007305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d214aa7-47ef-466e-9c70-06c889e8d5f0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:33.026414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 181/353] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:33.036574 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ee155-b9c4-4c23-b187-3fd845675fd9 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:33.042980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ee155-b9c4-4c23-b187-3fd845675fd9 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:33.052505 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5dbc9-144b-4d84-8820-745d33011776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:33.053387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5dbc9-144b-4d84-8820-745d33011776 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:33.053669 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5dbc9-144b-4d84-8820-745d33011776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:33.053933 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5dbc9-144b-4d84-8820-745d33011776 admin admin] PATH_INFO: `/v3/users/1971e8849e8f4db59b38d67b6eed4aa4` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:33.055181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5dbc9-144b-4d84-8820-745d33011776 admin admin] RBAC: Authorizing `identity:get_user(user_id=1971e8849e8f4db59b38d67b6eed4aa4)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:33.057749 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5dbc9-144b-4d84-8820-745d33011776 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:33.059865 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 173/354] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:14:33 2022] GET /identity/v3/users/1971e8849e8f4db59b38d67b6eed4aa4 => generated 293 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:33.068964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d214aa7-47ef-466e-9c70-06c889e8d5f0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:33.080800 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d214aa7-47ef-466e-9c70-06c889e8d5f0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:33.089628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7821897-49b7-4973-b2da-23622af9a1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:33.091828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821897-49b7-4973-b2da-23622af9a1ad admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:33.092141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821897-49b7-4973-b2da-23622af9a1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:33.092424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7821897-49b7-4973-b2da-23622af9a1ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:33.093315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821897-49b7-4973-b2da-23622af9a1ad admin admin] RBAC: Adding query filter params (role.id=da2cc800c7ad48d3a58d60617c9ed38e, user.id=1971e8849e8f4db59b38d67b6eed4aa4, scope.system=all) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:33.093693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821897-49b7-4973-b2da-23622af9a1ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:33.095928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7821897-49b7-4973-b2da-23622af9a1ad admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:33.105946 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf78d-3c1d-4066-a6e2-21d8bb81c38a None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:33.108465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf78d-3c1d-4066-a6e2-21d8bb81c38a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:33.108465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf78d-3c1d-4066-a6e2-21d8bb81c38a None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:33.109233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 174/355] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:33.119762 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7c57-0a32-426f-9433-1555808d8d63 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:33.120157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7c57-0a32-426f-9433-1555808d8d63 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:33.120389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af7c57-0a32-426f-9433-1555808d8d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:33.130634 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 182/356] 10.222.0.90 () {56 vars in 1329 bytes} [Wed Feb 16 09:14:33 2022] GET /identity/v3/role_assignments?user.id=1971e8849e8f4db59b38d67b6eed4aa4&scope.system=all&role.id=da2cc800c7ad48d3a58d60617c9ed38e => generated 510 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:33.161189 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-55af7c57-0a32-426f-9433-1555808d8d63 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:33.162492 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-55af7c57-0a32-426f-9433-1555808d8d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:33.177033 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 175/357] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:33.218822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7821897-49b7-4973-b2da-23622af9a1ad admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:33.233574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7821897-49b7-4973-b2da-23622af9a1ad admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:33.243768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e2f12-f708-4b1e-8d7f-f3c434456efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:33.243768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e2f12-f708-4b1e-8d7f-f3c434456efb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:33.243768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e2f12-f708-4b1e-8d7f-f3c434456efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:33.243768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e2f12-f708-4b1e-8d7f-f3c434456efb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:33.262534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e2f12-f708-4b1e-8d7f-f3c434456efb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:33.271631 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-080e2f12-f708-4b1e-8d7f-f3c434456efb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:33.277494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 183/358] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:33.284917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7c57-0a32-426f-9433-1555808d8d63 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:33.299072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af7c57-0a32-426f-9433-1555808d8d63 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:33.306306 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956e024-c2f7-4342-837d-c7dbafe419b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:33.306991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956e024-c2f7-4342-837d-c7dbafe419b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:33.307262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956e024-c2f7-4342-837d-c7dbafe419b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:33.307533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f956e024-c2f7-4342-837d-c7dbafe419b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:33.308383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956e024-c2f7-4342-837d-c7dbafe419b6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:33.308841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956e024-c2f7-4342-837d-c7dbafe419b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:33.311015 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f956e024-c2f7-4342-837d-c7dbafe419b6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:33.328128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 176/359] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:33.334072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e2f12-f708-4b1e-8d7f-f3c434456efb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:33.348928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e2f12-f708-4b1e-8d7f-f3c434456efb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:33.363183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf01702-4088-4c03-a10f-4e7e6b9f1637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:33.364242 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf01702-4088-4c03-a10f-4e7e6b9f1637 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:33.364722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf01702-4088-4c03-a10f-4e7e6b9f1637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:33.365227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf01702-4088-4c03-a10f-4e7e6b9f1637 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:33.381740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf01702-4088-4c03-a10f-4e7e6b9f1637 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:33.383895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf01702-4088-4c03-a10f-4e7e6b9f1637 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:33.398650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 184/360] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:33.404117 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956e024-c2f7-4342-837d-c7dbafe419b6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:33.423837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f956e024-c2f7-4342-837d-c7dbafe419b6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:33.431154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5d414-25be-4763-90ce-5644927ffed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:33.432050 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5d414-25be-4763-90ce-5644927ffed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:33.432322 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5d414-25be-4763-90ce-5644927ffed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:33.432594 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5d414-25be-4763-90ce-5644927ffed5 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:33.436853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5d414-25be-4763-90ce-5644927ffed5 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:33.439706 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5d414-25be-4763-90ce-5644927ffed5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:33.441878 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 177/361] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:33 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:33.448217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf01702-4088-4c03-a10f-4e7e6b9f1637 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:33.459137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf01702-4088-4c03-a10f-4e7e6b9f1637 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:33.468254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37735c8-6a4b-4b8d-9944-368bb180eabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:33.469477 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37735c8-6a4b-4b8d-9944-368bb180eabe admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:33.469953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37735c8-6a4b-4b8d-9944-368bb180eabe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:33.470420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37735c8-6a4b-4b8d-9944-368bb180eabe admin admin] PATH_INFO: `/v3/groups/acf2887dc79743b798eda4b7d8d7e948` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:33.471831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37735c8-6a4b-4b8d-9944-368bb180eabe admin admin] RBAC: Authorizing `identity:get_group(group_id=acf2887dc79743b798eda4b7d8d7e948)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:33.473076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-e37735c8-6a4b-4b8d-9944-368bb180eabe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:33.473076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:14:33.473076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:14:33.474621 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37735c8-6a4b-4b8d-9944-368bb180eabe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:33.477071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 185/362] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:33 2022] GET /identity/v3/groups/acf2887dc79743b798eda4b7d8d7e948 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:33.482651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5d414-25be-4763-90ce-5644927ffed5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:33.497556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5d414-25be-4763-90ce-5644927ffed5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:33.507244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744dfb9-c425-49a2-9e17-b4af57845c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:33.507795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744dfb9-c425-49a2-9e17-b4af57845c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:33.508097 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744dfb9-c425-49a2-9e17-b4af57845c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:33.508372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744dfb9-c425-49a2-9e17-b4af57845c80 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:33.509199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744dfb9-c425-49a2-9e17-b4af57845c80 admin admin] RBAC: Adding query filter params (group.id=acf2887dc79743b798eda4b7d8d7e948, role.id=34d194b1309f45d9a8ad70d08ccb4230, scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:33.509503 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744dfb9-c425-49a2-9e17-b4af57845c80 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:33.511333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744dfb9-c425-49a2-9e17-b4af57845c80 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:33.520638 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 178/363] 10.222.0.90 () {56 vars in 1397 bytes} [Wed Feb 16 09:14:33 2022] GET /identity/v3/role_assignments?group.id=acf2887dc79743b798eda4b7d8d7e948&scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba&role.id=34d194b1309f45d9a8ad70d08ccb4230 => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:34.109631 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc697fd-37a2-43c6-a5e5-7a3d158a1d2d None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:34.110642 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc697fd-37a2-43c6-a5e5-7a3d158a1d2d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:34.111134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc697fd-37a2-43c6-a5e5-7a3d158a1d2d None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:34.113485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 186/364] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:34.119310 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1921762-72f1-48ba-95c9-1778477ec0cd None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:34.119890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1921762-72f1-48ba-95c9-1778477ec0cd None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:34.120648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1921762-72f1-48ba-95c9-1778477ec0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:34.154049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-b1921762-72f1-48ba-95c9-1778477ec0cd None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:34.155644 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-b1921762-72f1-48ba-95c9-1778477ec0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:34.167520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 179/365] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:34.193271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc697fd-37a2-43c6-a5e5-7a3d158a1d2d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:34.210532 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc697fd-37a2-43c6-a5e5-7a3d158a1d2d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:34.215420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7e874-4e3a-4211-943d-7ad32d2da8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:34.216492 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7e874-4e3a-4211-943d-7ad32d2da8bb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:34.216972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7e874-4e3a-4211-943d-7ad32d2da8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:34.217460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7e874-4e3a-4211-943d-7ad32d2da8bb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:34.235799 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7e874-4e3a-4211-943d-7ad32d2da8bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:34.243321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-f4d7e874-4e3a-4211-943d-7ad32d2da8bb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:34.245058 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 187/366] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:34.251347 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1921762-72f1-48ba-95c9-1778477ec0cd None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:34.260759 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1921762-72f1-48ba-95c9-1778477ec0cd None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:34.267705 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159bc8b-ebfc-4a42-a772-878745d2fd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:34.268660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159bc8b-ebfc-4a42-a772-878745d2fd2e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:34.269142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159bc8b-ebfc-4a42-a772-878745d2fd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:34.269628 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159bc8b-ebfc-4a42-a772-878745d2fd2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:34.270580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159bc8b-ebfc-4a42-a772-878745d2fd2e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:34.271093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159bc8b-ebfc-4a42-a772-878745d2fd2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:34.272926 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159bc8b-ebfc-4a42-a772-878745d2fd2e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:34.287118 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 180/367] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:34.292817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7e874-4e3a-4211-943d-7ad32d2da8bb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:34.304201 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7e874-4e3a-4211-943d-7ad32d2da8bb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:34.312184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109867c-433c-47ed-bd98-be4179644aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:34.313491 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109867c-433c-47ed-bd98-be4179644aef admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:34.314060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109867c-433c-47ed-bd98-be4179644aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:34.314532 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109867c-433c-47ed-bd98-be4179644aef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:34.329080 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109867c-433c-47ed-bd98-be4179644aef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:34.331138 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109867c-433c-47ed-bd98-be4179644aef admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:34.345958 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 188/368] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:34.352304 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159bc8b-ebfc-4a42-a772-878745d2fd2e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:34.363032 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159bc8b-ebfc-4a42-a772-878745d2fd2e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:34.368006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef111441-1d9b-400e-aa98-937074d4e126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:34.369109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef111441-1d9b-400e-aa98-937074d4e126 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:34.369585 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef111441-1d9b-400e-aa98-937074d4e126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:34.370051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef111441-1d9b-400e-aa98-937074d4e126 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:34.372952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef111441-1d9b-400e-aa98-937074d4e126 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:34.376407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef111441-1d9b-400e-aa98-937074d4e126 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:34.378587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 181/369] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:34 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:34.384294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109867c-433c-47ed-bd98-be4179644aef admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:34.394340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109867c-433c-47ed-bd98-be4179644aef admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:34.401487 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb01165-10e5-4eef-8625-57fec6e2468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:34.402598 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01165-10e5-4eef-8625-57fec6e2468e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:34.403076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01165-10e5-4eef-8625-57fec6e2468e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:34.403543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb01165-10e5-4eef-8625-57fec6e2468e admin admin] PATH_INFO: `/v3/groups/acf2887dc79743b798eda4b7d8d7e948` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:34.408733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb01165-10e5-4eef-8625-57fec6e2468e admin admin] RBAC: Authorizing `identity:get_group(group_id=acf2887dc79743b798eda4b7d8d7e948)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:34.410864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb01165-10e5-4eef-8625-57fec6e2468e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:34.412685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 189/370] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:34 2022] GET /identity/v3/groups/acf2887dc79743b798eda4b7d8d7e948 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:34.418631 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef111441-1d9b-400e-aa98-937074d4e126 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:34.433069 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef111441-1d9b-400e-aa98-937074d4e126 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:34.444678 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589619f7-d27b-4ab5-b24c-250ce4733e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:34.445622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589619f7-d27b-4ab5-b24c-250ce4733e60 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:34.446105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589619f7-d27b-4ab5-b24c-250ce4733e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:34.446571 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589619f7-d27b-4ab5-b24c-250ce4733e60 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:34.447596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589619f7-d27b-4ab5-b24c-250ce4733e60 admin admin] RBAC: Adding query filter params (group.id=acf2887dc79743b798eda4b7d8d7e948, role.id=34d194b1309f45d9a8ad70d08ccb4230, scope.project.id=ac4c94add81c409d847b103179d99972) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:34.448130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589619f7-d27b-4ab5-b24c-250ce4733e60 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:34.450192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589619f7-d27b-4ab5-b24c-250ce4733e60 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:34.457218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 182/371] 10.222.0.90 () {56 vars in 1397 bytes} [Wed Feb 16 09:14:34 2022] GET /identity/v3/role_assignments?group.id=acf2887dc79743b798eda4b7d8d7e948&scope.project.id=ac4c94add81c409d847b103179d99972&role.id=34d194b1309f45d9a8ad70d08ccb4230 => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:34.881713 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ae22-470d-4f8d-8037-d8430261d0cb None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:34.882398 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ae22-470d-4f8d-8037-d8430261d0cb None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:34.882884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f30ae22-470d-4f8d-8037-d8430261d0cb None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:34.885434 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 190/372] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:34.892170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa0b34-e0c0-4c97-9879-89aff0c322a2 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:34.892466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa0b34-e0c0-4c97-9879-89aff0c322a2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:34.892745 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa0b34-e0c0-4c97-9879-89aff0c322a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:34.914983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-1daa0b34-e0c0-4c97-9879-89aff0c322a2 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:34.916494 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1daa0b34-e0c0-4c97-9879-89aff0c322a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:34.929145 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 183/373] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:34.969597 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30ae22-470d-4f8d-8037-d8430261d0cb None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:34.986052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f30ae22-470d-4f8d-8037-d8430261d0cb None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:34.994901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b4fb3-1ab0-4554-baa9-73dd80c465e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:34.995680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b4fb3-1ab0-4554-baa9-73dd80c465e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:34.995956 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b4fb3-1ab0-4554-baa9-73dd80c465e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:34.996248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b4fb3-1ab0-4554-baa9-73dd80c465e0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:35.021174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b4fb3-1ab0-4554-baa9-73dd80c465e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:35.027948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a81b4fb3-1ab0-4554-baa9-73dd80c465e0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:14:35.033529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 191/374] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:14:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:35.040457 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa0b34-e0c0-4c97-9879-89aff0c322a2 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:35.053214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa0b34-e0c0-4c97-9879-89aff0c322a2 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:35.066791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c5d53-0dd5-48da-a83c-23450a92a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:35.067778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c5d53-0dd5-48da-a83c-23450a92a25a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:35.068306 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c5d53-0dd5-48da-a83c-23450a92a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:35.068781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c5d53-0dd5-48da-a83c-23450a92a25a admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:35.069721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c5d53-0dd5-48da-a83c-23450a92a25a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:35.070238 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c5d53-0dd5-48da-a83c-23450a92a25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:35.072058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c5d53-0dd5-48da-a83c-23450a92a25a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:35.084357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 184/375] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:35.090172 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b4fb3-1ab0-4554-baa9-73dd80c465e0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:35.103554 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b4fb3-1ab0-4554-baa9-73dd80c465e0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:35.108311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a0127-5284-4a07-b858-5ecc582ea979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:35.109073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a0127-5284-4a07-b858-5ecc582ea979 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:35.109400 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a0127-5284-4a07-b858-5ecc582ea979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:35.109897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a0127-5284-4a07-b858-5ecc582ea979 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:35.126353 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a0127-5284-4a07-b858-5ecc582ea979 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:35.128433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a0127-5284-4a07-b858-5ecc582ea979 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:35.142683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 192/376] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:35.148252 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c5d53-0dd5-48da-a83c-23450a92a25a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:35.165330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c5d53-0dd5-48da-a83c-23450a92a25a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:35.176718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc47e30-de72-41a0-9e1c-0f6b75dfb26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:35.177586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc47e30-de72-41a0-9e1c-0f6b75dfb26c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:35.177867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc47e30-de72-41a0-9e1c-0f6b75dfb26c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:35.178142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc47e30-de72-41a0-9e1c-0f6b75dfb26c admin admin] PATH_INFO: `/v3/projects/452aa210ed214b4b8bc6178a127c766b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:35.183378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc47e30-de72-41a0-9e1c-0f6b75dfb26c admin admin] RBAC: Authorizing `identity:get_project(project_id=452aa210ed214b4b8bc6178a127c766b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:35.185277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc47e30-de72-41a0-9e1c-0f6b75dfb26c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:35.187894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 185/377] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:35 2022] GET /identity/v3/projects/452aa210ed214b4b8bc6178a127c766b => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:35.194055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a0127-5284-4a07-b858-5ecc582ea979 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:35.208601 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a0127-5284-4a07-b858-5ecc582ea979 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:35.213936 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6f787-a58e-4f09-ac5a-8a8f881a6426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:35.215012 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6f787-a58e-4f09-ac5a-8a8f881a6426 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:35.215557 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6f787-a58e-4f09-ac5a-8a8f881a6426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:35.216069 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6f787-a58e-4f09-ac5a-8a8f881a6426 admin admin] PATH_INFO: `/v3/groups/390c23a209ed44619170d750d9172509` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:35.228738 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6f787-a58e-4f09-ac5a-8a8f881a6426 admin admin] RBAC: Authorizing `identity:get_group(group_id=390c23a209ed44619170d750d9172509)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:35.231087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6f787-a58e-4f09-ac5a-8a8f881a6426 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:35.233001 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 193/378] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:35 2022] GET /identity/v3/groups/390c23a209ed44619170d750d9172509 => generated 229 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:35.239961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc47e30-de72-41a0-9e1c-0f6b75dfb26c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:35.255822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc47e30-de72-41a0-9e1c-0f6b75dfb26c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:35.265122 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407361b1-edf2-4e73-a893-23d5708355cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:35.266746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407361b1-edf2-4e73-a893-23d5708355cf admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:35.267080 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407361b1-edf2-4e73-a893-23d5708355cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:35.267357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407361b1-edf2-4e73-a893-23d5708355cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:35.268214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407361b1-edf2-4e73-a893-23d5708355cf admin admin] RBAC: Adding query filter params (group.id=390c23a209ed44619170d750d9172509, role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=452aa210ed214b4b8bc6178a127c766b) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:35.268525 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407361b1-edf2-4e73-a893-23d5708355cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:35.270389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407361b1-edf2-4e73-a893-23d5708355cf admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:35.285633 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 186/379] 10.222.0.90 () {56 vars in 1397 bytes} [Wed Feb 16 09:14:35 2022] GET /identity/v3/role_assignments?group.id=390c23a209ed44619170d750d9172509&scope.project.id=452aa210ed214b4b8bc6178a127c766b&role.id=0e45946c6336419abb2015d8916e31ca => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:36.120249 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d787fe7-e33b-4ca6-ae5a-531db9707087 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.121244 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d787fe7-e33b-4ca6-ae5a-531db9707087 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.121744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d787fe7-e33b-4ca6-ae5a-531db9707087 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.123970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 194/380] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:36.129893 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35e135-660e-4922-819c-93ca419a201a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.130768 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35e135-660e-4922-819c-93ca419a201a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.131240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35e135-660e-4922-819c-93ca419a201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.157607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-8d35e135-660e-4922-819c-93ca419a201a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:36.159123 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8d35e135-660e-4922-819c-93ca419a201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:36.167565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 187/381] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:36.172719 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e6972-3fc6-435e-a01f-1a7a413711ef None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.173329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e6972-3fc6-435e-a01f-1a7a413711ef None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.173810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e6972-3fc6-435e-a01f-1a7a413711ef None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.175777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 195/382] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:36.189588 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9d97d-3ee1-465e-8479-dd6671ed5450 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.190149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9d97d-3ee1-465e-8479-dd6671ed5450 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.190619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9d97d-3ee1-465e-8479-dd6671ed5450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.194060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e6972-3fc6-435e-a01f-1a7a413711ef None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:36.219900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e6972-3fc6-435e-a01f-1a7a413711ef None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:36.229473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548807-dde9-4b64-808a-8bacfd68624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:36.230568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548807-dde9-4b64-808a-8bacfd68624f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.231070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548807-dde9-4b64-808a-8bacfd68624f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.231542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548807-dde9-4b64-808a-8bacfd68624f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.242985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-09e9d97d-3ee1-465e-8479-dd6671ed5450 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:36.244797 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-09e9d97d-3ee1-465e-8479-dd6671ed5450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:36.257519 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1548807-dde9-4b64-808a-8bacfd68624f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:36.268271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-f1548807-dde9-4b64-808a-8bacfd68624f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:36.273791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 188/383] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:36.275286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 196/384] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:36.281598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9d97d-3ee1-465e-8479-dd6671ed5450 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:36.298317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9d97d-3ee1-465e-8479-dd6671ed5450 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:36.301204 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548807-dde9-4b64-808a-8bacfd68624f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:36.308507 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d375-6310-491a-978f-d9edef9fb0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:36.310225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d375-6310-491a-978f-d9edef9fb0bb admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.310754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d375-6310-491a-978f-d9edef9fb0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.311541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d375-6310-491a-978f-d9edef9fb0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.313450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80d375-6310-491a-978f-d9edef9fb0bb admin admin] RBAC: Adding query filter params (name=member) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:36.314037 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80d375-6310-491a-978f-d9edef9fb0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:36.314408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548807-dde9-4b64-808a-8bacfd68624f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:36.316156 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80d375-6310-491a-978f-d9edef9fb0bb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:36.319431 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bce455-e18f-42e6-9973-408d70cc862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:36.320313 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bce455-e18f-42e6-9973-408d70cc862f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.320652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bce455-e18f-42e6-9973-408d70cc862f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.320932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bce455-e18f-42e6-9973-408d70cc862f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.331920 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 189/385] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:36.334218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bce455-e18f-42e6-9973-408d70cc862f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:36.337413 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d375-6310-491a-978f-d9edef9fb0bb admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:36.341582 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-b2bce455-e18f-42e6-9973-408d70cc862f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:36.344121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 197/386] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:36.350664 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d375-6310-491a-978f-d9edef9fb0bb admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:36.351324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bce455-e18f-42e6-9973-408d70cc862f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:36.362497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bce455-e18f-42e6-9973-408d70cc862f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:36.363432 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ca1d3-c513-492f-933e-132a48bb2dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:36.364554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ca1d3-c513-492f-933e-132a48bb2dcd admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.365031 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ca1d3-c513-492f-933e-132a48bb2dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.365526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ca1d3-c513-492f-933e-132a48bb2dcd admin admin] PATH_INFO: `/v3/groups/acf2887dc79743b798eda4b7d8d7e948` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.366919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ca1d3-c513-492f-933e-132a48bb2dcd admin admin] RBAC: Authorizing `identity:get_group(group_id=acf2887dc79743b798eda4b7d8d7e948)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:36.367281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa4417-412c-4d19-9a48-f948b1ac36a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:36.367929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa4417-412c-4d19-9a48-f948b1ac36a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.368333 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa4417-412c-4d19-9a48-f948b1ac36a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.368615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa4417-412c-4d19-9a48-f948b1ac36a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.369413 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa4417-412c-4d19-9a48-f948b1ac36a5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:36.369911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa4417-412c-4d19-9a48-f948b1ac36a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:36.370363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ca1d3-c513-492f-933e-132a48bb2dcd admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:36.371653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa4417-412c-4d19-9a48-f948b1ac36a5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:36.372736 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 190/387] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:36 2022] GET /identity/v3/groups/acf2887dc79743b798eda4b7d8d7e948 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:36.378390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ca1d3-c513-492f-933e-132a48bb2dcd admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:36.385472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 198/388] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:36.392152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa4417-412c-4d19-9a48-f948b1ac36a5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:36.397637 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ca1d3-c513-492f-933e-132a48bb2dcd admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:36.403390 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa4417-412c-4d19-9a48-f948b1ac36a5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:36.409517 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dbf6d-fa66-491b-bed5-9d1b90177ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:36.410276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fa4e2-754e-48b9-b825-3c16c1668e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:36.410397 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dbf6d-fa66-491b-bed5-9d1b90177ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.410692 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dbf6d-fa66-491b-bed5-9d1b90177ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.411016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dbf6d-fa66-491b-bed5-9d1b90177ee5 admin admin] PATH_INFO: `/v3/groups/acf2887dc79743b798eda4b7d8d7e948` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.411872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa4e2-754e-48b9-b825-3c16c1668e79 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.412280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dbf6d-fa66-491b-bed5-9d1b90177ee5 admin admin] RBAC: Authorizing `identity:get_group(group_id=acf2887dc79743b798eda4b7d8d7e948)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:36.412596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa4e2-754e-48b9-b825-3c16c1668e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.413068 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa4e2-754e-48b9-b825-3c16c1668e79 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.416045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dbf6d-fa66-491b-bed5-9d1b90177ee5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:36.416217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 199/389] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:36 2022] GET /identity/v3/groups/acf2887dc79743b798eda4b7d8d7e948 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:36.417051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fa4e2-754e-48b9-b825-3c16c1668e79 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:36.419264 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fa4e2-754e-48b9-b825-3c16c1668e79 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:36.421157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 191/390] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:36 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:36.422241 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dbf6d-fa66-491b-bed5-9d1b90177ee5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:36.427472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fa4e2-754e-48b9-b825-3c16c1668e79 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:36.433296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dbf6d-fa66-491b-bed5-9d1b90177ee5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:36.438695 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14177478-4384-4007-8836-c3fa8ff4a87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:36.439599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14177478-4384-4007-8836-c3fa8ff4a87b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.439887 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14177478-4384-4007-8836-c3fa8ff4a87b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.440203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14177478-4384-4007-8836-c3fa8ff4a87b admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.442098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14177478-4384-4007-8836-c3fa8ff4a87b admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:36.444576 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14177478-4384-4007-8836-c3fa8ff4a87b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:36.444839 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fa4e2-754e-48b9-b825-3c16c1668e79 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:36.446473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 200/391] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:36 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:36.452133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14177478-4384-4007-8836-c3fa8ff4a87b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:36.461226 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81628cb0-4028-44d3-a445-3bd8147926bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:36.462361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81628cb0-4028-44d3-a445-3bd8147926bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.462949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81628cb0-4028-44d3-a445-3bd8147926bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.463421 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81628cb0-4028-44d3-a445-3bd8147926bf admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972/groups/acf2887dc79743b798eda4b7d8d7e948/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.463524 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14177478-4384-4007-8836-c3fa8ff4a87b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:36.468137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888fea1-e7c9-4684-8530-cd9102beed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:36.470597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81628cb0-4028-44d3-a445-3bd8147926bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4c94add81c409d847b103179d99972, group_id=acf2887dc79743b798eda4b7d8d7e948, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:36.470719 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888fea1-e7c9-4684-8530-cd9102beed36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.470928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888fea1-e7c9-4684-8530-cd9102beed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.471211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888fea1-e7c9-4684-8530-cd9102beed36 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba/groups/acf2887dc79743b798eda4b7d8d7e948/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.473340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888fea1-e7c9-4684-8530-cd9102beed36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, group_id=acf2887dc79743b798eda4b7d8d7e948, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:36.474235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81628cb0-4028-44d3-a445-3bd8147926bf admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:36.476177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888fea1-e7c9-4684-8530-cd9102beed36 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:36.493141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 201/392] 10.222.0.90 () {58 vars in 1463 bytes} [Wed Feb 16 09:14:36 2022] PUT /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba/groups/acf2887dc79743b798eda4b7d8d7e948/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:14:36.503253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 192/393] 10.222.0.90 () {58 vars in 1463 bytes} [Wed Feb 16 09:14:36 2022] PUT /identity/v3/projects/ac4c94add81c409d847b103179d99972/groups/acf2887dc79743b798eda4b7d8d7e948/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:14:36.813194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa273c-fd53-49d2-8dc5-a0d2265c829c None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.813610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa273c-fd53-49d2-8dc5-a0d2265c829c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.813908 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa273c-fd53-49d2-8dc5-a0d2265c829c None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.815951 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 202/394] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:36.821165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609307-e02b-46b5-a96f-7b3004cd12d7 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.821456 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609307-e02b-46b5-a96f-7b3004cd12d7 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.821735 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609307-e02b-46b5-a96f-7b3004cd12d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:36.842979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-24609307-e02b-46b5-a96f-7b3004cd12d7 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:36.844688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-24609307-e02b-46b5-a96f-7b3004cd12d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:36.927016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 193/395] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:36.974636 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa273c-fd53-49d2-8dc5-a0d2265c829c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:36.987890 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa273c-fd53-49d2-8dc5-a0d2265c829c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:36.992892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec393b1-1f69-46c7-9bd0-7f5f89356ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:36.993736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec393b1-1f69-46c7-9bd0-7f5f89356ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:36.994018 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec393b1-1f69-46c7-9bd0-7f5f89356ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:36.994370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec393b1-1f69-46c7-9bd0-7f5f89356ad8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:37.006556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec393b1-1f69-46c7-9bd0-7f5f89356ad8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:37.018201 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-2ec393b1-1f69-46c7-9bd0-7f5f89356ad8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:37.019831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 203/396] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:37.025349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24609307-e02b-46b5-a96f-7b3004cd12d7 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:37.035681 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24609307-e02b-46b5-a96f-7b3004cd12d7 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:37.043815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac870d-b592-4510-8c0d-5bfa342f224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:37.044531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac870d-b592-4510-8c0d-5bfa342f224e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:37.044866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac870d-b592-4510-8c0d-5bfa342f224e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:37.045145 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac870d-b592-4510-8c0d-5bfa342f224e admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:37.045943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac870d-b592-4510-8c0d-5bfa342f224e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:37.046250 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac870d-b592-4510-8c0d-5bfa342f224e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:37.048771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac870d-b592-4510-8c0d-5bfa342f224e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:37.058036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 194/397] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:37.064310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec393b1-1f69-46c7-9bd0-7f5f89356ad8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:37.075169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec393b1-1f69-46c7-9bd0-7f5f89356ad8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:37.080418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb916ef-3835-4be2-9f43-1336e3c6496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:37.081309 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb916ef-3835-4be2-9f43-1336e3c6496b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:37.081595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb916ef-3835-4be2-9f43-1336e3c6496b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:37.081928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb916ef-3835-4be2-9f43-1336e3c6496b admin admin] PATH_INFO: `/v3/groups/acf2887dc79743b798eda4b7d8d7e948` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:37.083167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb916ef-3835-4be2-9f43-1336e3c6496b admin admin] RBAC: Authorizing `identity:get_group(group_id=acf2887dc79743b798eda4b7d8d7e948)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:37.085171 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb916ef-3835-4be2-9f43-1336e3c6496b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:37.086880 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 204/398] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:37 2022] GET /identity/v3/groups/acf2887dc79743b798eda4b7d8d7e948 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:37.092589 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac870d-b592-4510-8c0d-5bfa342f224e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:37.103892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac870d-b592-4510-8c0d-5bfa342f224e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:37.108634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e4145-7e6e-4f4a-afa5-05657a9e35c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:37.110138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e4145-7e6e-4f4a-afa5-05657a9e35c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:37.110522 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e4145-7e6e-4f4a-afa5-05657a9e35c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:37.110857 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e4145-7e6e-4f4a-afa5-05657a9e35c3 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:37.112200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e4145-7e6e-4f4a-afa5-05657a9e35c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:37.114380 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e4145-7e6e-4f4a-afa5-05657a9e35c3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:37.116437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 195/399] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:37 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:37.125804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb916ef-3835-4be2-9f43-1336e3c6496b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:37.136293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb916ef-3835-4be2-9f43-1336e3c6496b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:37.141721 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3bc73-9d1c-4b74-a92f-9dd31d3e3a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:37.142645 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3bc73-9d1c-4b74-a92f-9dd31d3e3a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:37.142927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3bc73-9d1c-4b74-a92f-9dd31d3e3a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:37.143244 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3bc73-9d1c-4b74-a92f-9dd31d3e3a38 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba/groups/acf2887dc79743b798eda4b7d8d7e948/roles/34d194b1309f45d9a8ad70d08ccb4230` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:37.145625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3bc73-9d1c-4b74-a92f-9dd31d3e3a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba, group_id=acf2887dc79743b798eda4b7d8d7e948, role_id=34d194b1309f45d9a8ad70d08ccb4230)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:37.152509 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3bc73-9d1c-4b74-a92f-9dd31d3e3a38 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:37.180258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 205/400] 10.222.0.90 () {58 vars in 1463 bytes} [Wed Feb 16 09:14:37 2022] PUT /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba/groups/acf2887dc79743b798eda4b7d8d7e948/roles/34d194b1309f45d9a8ad70d08ccb4230 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:37.736166 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece8046-6c74-4aa7-8b03-6f293fd64b00 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:37.736897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece8046-6c74-4aa7-8b03-6f293fd64b00 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:37.736897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece8046-6c74-4aa7-8b03-6f293fd64b00 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:37.738460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 196/401] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:37.743956 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d3e99-9f1d-4dee-b8f1-c0a57c3526b5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:37.744265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d3e99-9f1d-4dee-b8f1-c0a57c3526b5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:37.744539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d3e99-9f1d-4dee-b8f1-c0a57c3526b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:37.765738 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9a1d3e99-9f1d-4dee-b8f1-c0a57c3526b5 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:37.766907 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9a1d3e99-9f1d-4dee-b8f1-c0a57c3526b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:37.844455 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 206/402] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:37.886201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece8046-6c74-4aa7-8b03-6f293fd64b00 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:37.906031 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece8046-6c74-4aa7-8b03-6f293fd64b00 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:37.910719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21beff-fa40-4de1-85f6-9dd174c37cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:37.911782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21beff-fa40-4de1-85f6-9dd174c37cac admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:37.912302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21beff-fa40-4de1-85f6-9dd174c37cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:37.912777 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21beff-fa40-4de1-85f6-9dd174c37cac admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:37.928393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21beff-fa40-4de1-85f6-9dd174c37cac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:37.935953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-fd21beff-fa40-4de1-85f6-9dd174c37cac admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:37.942805 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 197/403] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:37.943794 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d3e99-9f1d-4dee-b8f1-c0a57c3526b5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:37.962222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d3e99-9f1d-4dee-b8f1-c0a57c3526b5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:37.970570 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d85053-ff5e-4df1-9f0d-ce0d5bdb8a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:37.971307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d85053-ff5e-4df1-9f0d-ce0d5bdb8a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:37.971588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d85053-ff5e-4df1-9f0d-ce0d5bdb8a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:37.972004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d85053-ff5e-4df1-9f0d-ce0d5bdb8a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:37.972816 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d85053-ff5e-4df1-9f0d-ce0d5bdb8a65 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:37.973123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d85053-ff5e-4df1-9f0d-ce0d5bdb8a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:37.974726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d85053-ff5e-4df1-9f0d-ce0d5bdb8a65 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:37.994645 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 207/404] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:38.000935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21beff-fa40-4de1-85f6-9dd174c37cac admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:38.020054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21beff-fa40-4de1-85f6-9dd174c37cac admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:38.029968 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826af5a1-4e7f-461d-86f8-c66d14aca1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:38.031407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826af5a1-4e7f-461d-86f8-c66d14aca1ca admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:38.031882 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826af5a1-4e7f-461d-86f8-c66d14aca1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:38.032419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826af5a1-4e7f-461d-86f8-c66d14aca1ca admin admin] PATH_INFO: `/v3/groups/acf2887dc79743b798eda4b7d8d7e948` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:38.033910 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826af5a1-4e7f-461d-86f8-c66d14aca1ca admin admin] RBAC: Authorizing `identity:get_group(group_id=acf2887dc79743b798eda4b7d8d7e948)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:38.036063 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826af5a1-4e7f-461d-86f8-c66d14aca1ca admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:38.037950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 198/405] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:37 2022] GET /identity/v3/groups/acf2887dc79743b798eda4b7d8d7e948 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:38.043682 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d85053-ff5e-4df1-9f0d-ce0d5bdb8a65 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:38.057105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d85053-ff5e-4df1-9f0d-ce0d5bdb8a65 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:38.069608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc19769-f3f8-4173-9964-adba01c2170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:38.070472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc19769-f3f8-4173-9964-adba01c2170e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:38.070816 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc19769-f3f8-4173-9964-adba01c2170e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:38.071098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc19769-f3f8-4173-9964-adba01c2170e admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:38.072468 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc19769-f3f8-4173-9964-adba01c2170e admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:38.074513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc19769-f3f8-4173-9964-adba01c2170e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:38.076189 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 208/406] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:38 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:38.082010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826af5a1-4e7f-461d-86f8-c66d14aca1ca admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:38.092092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826af5a1-4e7f-461d-86f8-c66d14aca1ca admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:38.100046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa2b24-f232-42c6-abac-781815b2e908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:38.101157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa2b24-f232-42c6-abac-781815b2e908 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:38.101650 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa2b24-f232-42c6-abac-781815b2e908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:38.102126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa2b24-f232-42c6-abac-781815b2e908 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972/groups/acf2887dc79743b798eda4b7d8d7e948/roles/34d194b1309f45d9a8ad70d08ccb4230` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:38.104556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa2b24-f232-42c6-abac-781815b2e908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4c94add81c409d847b103179d99972, group_id=acf2887dc79743b798eda4b7d8d7e948, role_id=34d194b1309f45d9a8ad70d08ccb4230)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:38.107384 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa2b24-f232-42c6-abac-781815b2e908 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:38.133579 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 199/407] 10.222.0.90 () {58 vars in 1463 bytes} [Wed Feb 16 09:14:38 2022] PUT /identity/v3/projects/ac4c94add81c409d847b103179d99972/groups/acf2887dc79743b798eda4b7d8d7e948/roles/34d194b1309f45d9a8ad70d08ccb4230 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:38.857250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9ebff-75fa-432d-a1b3-b9da3eb0ca1e None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:38.858317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9ebff-75fa-432d-a1b3-b9da3eb0ca1e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:38.858902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9ebff-75fa-432d-a1b3-b9da3eb0ca1e None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:38.861876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 209/408] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:38.867520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e5470-6b20-457b-9cee-76ea4df8ae1a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:38.868389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e5470-6b20-457b-9cee-76ea4df8ae1a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:38.868886 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e5470-6b20-457b-9cee-76ea4df8ae1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:38.891409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-dc3e5470-6b20-457b-9cee-76ea4df8ae1a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:38.892944 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-dc3e5470-6b20-457b-9cee-76ea4df8ae1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:38.965625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 200/409] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:39.012132 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9ebff-75fa-432d-a1b3-b9da3eb0ca1e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.037481 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9ebff-75fa-432d-a1b3-b9da3eb0ca1e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.044510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe4da6-50c4-4592-8ba1-c09944ec001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.045327 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe4da6-50c4-4592-8ba1-c09944ec001d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.045664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe4da6-50c4-4592-8ba1-c09944ec001d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.045941 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe4da6-50c4-4592-8ba1-c09944ec001d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.068595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe4da6-50c4-4592-8ba1-c09944ec001d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:39.076137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-18fe4da6-50c4-4592-8ba1-c09944ec001d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:14:39.078332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 210/410] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:39.083988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e5470-6b20-457b-9cee-76ea4df8ae1a None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.099827 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e5470-6b20-457b-9cee-76ea4df8ae1a None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.107792 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b45d-0bd2-4f6c-9d33-d6e843ed24e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.108779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b45d-0bd2-4f6c-9d33-d6e843ed24e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.110134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b45d-0bd2-4f6c-9d33-d6e843ed24e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.110754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7b45d-0bd2-4f6c-9d33-d6e843ed24e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.111730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7b45d-0bd2-4f6c-9d33-d6e843ed24e0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:39.112267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7b45d-0bd2-4f6c-9d33-d6e843ed24e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.114087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7b45d-0bd2-4f6c-9d33-d6e843ed24e0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.128516 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 201/411] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:39.134102 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe4da6-50c4-4592-8ba1-c09944ec001d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.149193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe4da6-50c4-4592-8ba1-c09944ec001d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.156796 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1add0b5-5f96-4b37-a478-ebb4cab8bbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.157698 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1add0b5-5f96-4b37-a478-ebb4cab8bbbb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.157981 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1add0b5-5f96-4b37-a478-ebb4cab8bbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.158258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1add0b5-5f96-4b37-a478-ebb4cab8bbbb admin admin] PATH_INFO: `/v3/groups/390c23a209ed44619170d750d9172509` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.160579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1add0b5-5f96-4b37-a478-ebb4cab8bbbb admin admin] RBAC: Authorizing `identity:get_group(group_id=390c23a209ed44619170d750d9172509)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.162556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1add0b5-5f96-4b37-a478-ebb4cab8bbbb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.164460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 211/412] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/groups/390c23a209ed44619170d750d9172509 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:39.170230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b45d-0bd2-4f6c-9d33-d6e843ed24e0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.185771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7b45d-0bd2-4f6c-9d33-d6e843ed24e0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.195660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a051c-4eb6-4575-90ca-5ccbfd62b029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.196780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a051c-4eb6-4575-90ca-5ccbfd62b029 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.197273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a051c-4eb6-4575-90ca-5ccbfd62b029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.197751 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a051c-4eb6-4575-90ca-5ccbfd62b029 admin admin] PATH_INFO: `/v3/projects/452aa210ed214b4b8bc6178a127c766b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.200729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a051c-4eb6-4575-90ca-5ccbfd62b029 admin admin] RBAC: Authorizing `identity:get_project(project_id=452aa210ed214b4b8bc6178a127c766b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.203526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a051c-4eb6-4575-90ca-5ccbfd62b029 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.205898 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 202/413] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/projects/452aa210ed214b4b8bc6178a127c766b => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:39.211297 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1add0b5-5f96-4b37-a478-ebb4cab8bbbb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.225355 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1add0b5-5f96-4b37-a478-ebb4cab8bbbb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.232782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95621352-ca05-4864-bafd-bc8feb80888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.233656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621352-ca05-4864-bafd-bc8feb80888b admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.234067 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621352-ca05-4864-bafd-bc8feb80888b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.234507 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621352-ca05-4864-bafd-bc8feb80888b admin admin] PATH_INFO: `/v3/projects/452aa210ed214b4b8bc6178a127c766b/groups/390c23a209ed44619170d750d9172509/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.240047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95621352-ca05-4864-bafd-bc8feb80888b admin admin] RBAC: Authorizing `identity:create_grant(project_id=452aa210ed214b4b8bc6178a127c766b, group_id=390c23a209ed44619170d750d9172509, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.240349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95621352-ca05-4864-bafd-bc8feb80888b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.256929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 212/414] 10.222.0.90 () {58 vars in 1463 bytes} [Wed Feb 16 09:14:39 2022] PUT /identity/v3/projects/452aa210ed214b4b8bc6178a127c766b/groups/390c23a209ed44619170d750d9172509/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:39.437803 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7bbd0-0431-4526-8ce4-3ac8f02c0819 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.438302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7bbd0-0431-4526-8ce4-3ac8f02c0819 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.438721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7bbd0-0431-4526-8ce4-3ac8f02c0819 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.440911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 203/415] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:39.454627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97758942-4ac4-49fc-a833-428049e4e49d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.455264 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97758942-4ac4-49fc-a833-428049e4e49d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.455742 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97758942-4ac4-49fc-a833-428049e4e49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.479092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-97758942-4ac4-49fc-a833-428049e4e49d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:39.480666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-97758942-4ac4-49fc-a833-428049e4e49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:39.553747 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69053a-ff33-4bdf-8d45-ec5a2ee2c16d None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.554056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69053a-ff33-4bdf-8d45-ec5a2ee2c16d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.554288 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69053a-ff33-4bdf-8d45-ec5a2ee2c16d None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.555626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 213/416] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:39.559200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 204/417] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:39.566139 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed826e9-372e-45f6-bd35-176694c7ca9d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.566424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed826e9-372e-45f6-bd35-176694c7ca9d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.566697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed826e9-372e-45f6-bd35-176694c7ca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.585790 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4ed826e9-372e-45f6-bd35-176694c7ca9d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:39.586968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4ed826e9-372e-45f6-bd35-176694c7ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:39.591374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69053a-ff33-4bdf-8d45-ec5a2ee2c16d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.597349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 214/418] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:39.615518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69053a-ff33-4bdf-8d45-ec5a2ee2c16d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.619941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3cb14-df34-49ab-84bd-85cb74be0ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.620775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3cb14-df34-49ab-84bd-85cb74be0ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.621055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3cb14-df34-49ab-84bd-85cb74be0ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.621327 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3cb14-df34-49ab-84bd-85cb74be0ba9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.635033 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed826e9-372e-45f6-bd35-176694c7ca9d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.637196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3cb14-df34-49ab-84bd-85cb74be0ba9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:39.645488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-cbe3cb14-df34-49ab-84bd-85cb74be0ba9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:39.646743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed826e9-372e-45f6-bd35-176694c7ca9d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.647003 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 205/419] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:39.653140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3cb14-df34-49ab-84bd-85cb74be0ba9 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.655656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987996f-a69c-4f44-98be-2d877368b448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.656844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987996f-a69c-4f44-98be-2d877368b448 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.657180 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987996f-a69c-4f44-98be-2d877368b448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.657503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987996f-a69c-4f44-98be-2d877368b448 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.671535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987996f-a69c-4f44-98be-2d877368b448 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:39.671909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3cb14-df34-49ab-84bd-85cb74be0ba9 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.679879 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-5987996f-a69c-4f44-98be-2d877368b448 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 09:14:39.680917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96ae5e-4eea-49c6-8bad-b19f75f447d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.681636 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 215/420] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:39.681760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96ae5e-4eea-49c6-8bad-b19f75f447d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.682019 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96ae5e-4eea-49c6-8bad-b19f75f447d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.682368 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96ae5e-4eea-49c6-8bad-b19f75f447d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.683206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96ae5e-4eea-49c6-8bad-b19f75f447d6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:39.683601 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96ae5e-4eea-49c6-8bad-b19f75f447d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.685352 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96ae5e-4eea-49c6-8bad-b19f75f447d6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.688485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987996f-a69c-4f44-98be-2d877368b448 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.698290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 206/421] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:39.700299 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987996f-a69c-4f44-98be-2d877368b448 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.705204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96ae5e-4eea-49c6-8bad-b19f75f447d6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.705833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b58b1-d474-42a6-b96d-c47e5415de91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.706557 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b58b1-d474-42a6-b96d-c47e5415de91 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.706939 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b58b1-d474-42a6-b96d-c47e5415de91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.707210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b58b1-d474-42a6-b96d-c47e5415de91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.708014 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b58b1-d474-42a6-b96d-c47e5415de91 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:39.708352 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b58b1-d474-42a6-b96d-c47e5415de91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.710056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b58b1-d474-42a6-b96d-c47e5415de91 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.715862 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96ae5e-4eea-49c6-8bad-b19f75f447d6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.721043 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bc387-7849-4447-9663-aacf58e49f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.721686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc387-7849-4447-9663-aacf58e49f3a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.721995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 216/422] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:39.722173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc387-7849-4447-9663-aacf58e49f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.722334 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc387-7849-4447-9663-aacf58e49f3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.727785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b58b1-d474-42a6-b96d-c47e5415de91 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.735057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bc387-7849-4447-9663-aacf58e49f3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.737387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bc387-7849-4447-9663-aacf58e49f3a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.739907 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b58b1-d474-42a6-b96d-c47e5415de91 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.745288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7672000-0c78-4281-a737-261e687a6c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.745918 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7672000-0c78-4281-a737-261e687a6c22 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.746195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7672000-0c78-4281-a737-261e687a6c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.746467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7672000-0c78-4281-a737-261e687a6c22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.747443 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 207/423] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:39.753749 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bc387-7849-4447-9663-aacf58e49f3a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.755701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7672000-0c78-4281-a737-261e687a6c22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.757498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7672000-0c78-4281-a737-261e687a6c22 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.766835 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bc387-7849-4447-9663-aacf58e49f3a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.769425 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 217/424] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 09:14:39.774105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f394ec-ee10-4893-82ff-14791c6093f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.774966 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7672000-0c78-4281-a737-261e687a6c22 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.775441 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f394ec-ee10-4893-82ff-14791c6093f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.775934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f394ec-ee10-4893-82ff-14791c6093f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.776360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f394ec-ee10-4893-82ff-14791c6093f9 admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.777653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f394ec-ee10-4893-82ff-14791c6093f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.779866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f394ec-ee10-4893-82ff-14791c6093f9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.781960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 208/425] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:39.785647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7672000-0c78-4281-a737-261e687a6c22 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.787481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f394ec-ee10-4893-82ff-14791c6093f9 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.790271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7eca7-194f-4712-9e44-e65abdc99619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.791391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7eca7-194f-4712-9e44-e65abdc99619 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.791670 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7eca7-194f-4712-9e44-e65abdc99619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.791940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7eca7-194f-4712-9e44-e65abdc99619 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.793429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7eca7-194f-4712-9e44-e65abdc99619 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.796187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7eca7-194f-4712-9e44-e65abdc99619 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.798530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 218/426] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:39.800518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f394ec-ee10-4893-82ff-14791c6093f9 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.803870 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7eca7-194f-4712-9e44-e65abdc99619 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.806951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43837965-1805-4d75-a0fc-1e670becd5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.807847 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43837965-1805-4d75-a0fc-1e670becd5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.808170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43837965-1805-4d75-a0fc-1e670becd5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.808445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43837965-1805-4d75-a0fc-1e670becd5e7 admin admin] PATH_INFO: `/v3/groups/acf2887dc79743b798eda4b7d8d7e948` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.809718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43837965-1805-4d75-a0fc-1e670becd5e7 admin admin] RBAC: Authorizing `identity:get_group(group_id=acf2887dc79743b798eda4b7d8d7e948)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.811809 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43837965-1805-4d75-a0fc-1e670becd5e7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.814148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7eca7-194f-4712-9e44-e65abdc99619 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.816172 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 209/427] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/groups/acf2887dc79743b798eda4b7d8d7e948 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:39.821442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43837965-1805-4d75-a0fc-1e670becd5e7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.830320 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7266b-ed2c-4ede-9d34-6c6ced3bf884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.831158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7266b-ed2c-4ede-9d34-6c6ced3bf884 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.831426 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7266b-ed2c-4ede-9d34-6c6ced3bf884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.831696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7266b-ed2c-4ede-9d34-6c6ced3bf884 admin admin] PATH_INFO: `/v3/groups/acf2887dc79743b798eda4b7d8d7e948` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.832925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7266b-ed2c-4ede-9d34-6c6ced3bf884 admin admin] RBAC: Authorizing `identity:get_group(group_id=acf2887dc79743b798eda4b7d8d7e948)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.834814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7266b-ed2c-4ede-9d34-6c6ced3bf884 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.836423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 219/428] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/groups/acf2887dc79743b798eda4b7d8d7e948 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:39.838282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43837965-1805-4d75-a0fc-1e670becd5e7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.842141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7266b-ed2c-4ede-9d34-6c6ced3bf884 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:39.843841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa9e76-8e5a-43d7-99de-61408c3df26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.845136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa9e76-8e5a-43d7-99de-61408c3df26b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.845641 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa9e76-8e5a-43d7-99de-61408c3df26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.846125 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa9e76-8e5a-43d7-99de-61408c3df26b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.847296 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa9e76-8e5a-43d7-99de-61408c3df26b admin admin] RBAC: Adding query filter params (group.id=acf2887dc79743b798eda4b7d8d7e948, role.id=4184b38195d04c3a88c76c1255f7c7f7, scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:39.847820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa9e76-8e5a-43d7-99de-61408c3df26b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.849968 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa9e76-8e5a-43d7-99de-61408c3df26b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.852820 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7266b-ed2c-4ede-9d34-6c6ced3bf884 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:39.857278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b731a1-017b-48ae-b48c-fac802f2bc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:39.857958 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b731a1-017b-48ae-b48c-fac802f2bc96 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:39.858172 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b731a1-017b-48ae-b48c-fac802f2bc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:39.858446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b731a1-017b-48ae-b48c-fac802f2bc96 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:39.859567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b731a1-017b-48ae-b48c-fac802f2bc96 admin admin] RBAC: Adding query filter params (group.id=acf2887dc79743b798eda4b7d8d7e948, role.id=4184b38195d04c3a88c76c1255f7c7f7, scope.project.id=ac4c94add81c409d847b103179d99972) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:39.859783 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b731a1-017b-48ae-b48c-fac802f2bc96 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:39.859881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 210/429] 10.222.0.90 () {56 vars in 1397 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/role_assignments?group.id=acf2887dc79743b798eda4b7d8d7e948&scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba&role.id=4184b38195d04c3a88c76c1255f7c7f7 => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:39.864127 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b731a1-017b-48ae-b48c-fac802f2bc96 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:39.869245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 220/430] 10.222.0.90 () {56 vars in 1397 bytes} [Wed Feb 16 09:14:39 2022] GET /identity/v3/role_assignments?group.id=acf2887dc79743b798eda4b7d8d7e948&scope.project.id=ac4c94add81c409d847b103179d99972&role.id=4184b38195d04c3a88c76c1255f7c7f7 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:40.654860 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501e177-9c4f-4eb6-b021-79acd7e35dbf None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:40.656049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501e177-9c4f-4eb6-b021-79acd7e35dbf None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:40.656590 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501e177-9c4f-4eb6-b021-79acd7e35dbf None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:40.658862 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 211/431] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:40.664777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c58006-069f-4b60-9979-4b9a6dc11164 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:40.665314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c58006-069f-4b60-9979-4b9a6dc11164 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:40.665808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c58006-069f-4b60-9979-4b9a6dc11164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:40.683952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-86c58006-069f-4b60-9979-4b9a6dc11164 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:40.685440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-86c58006-069f-4b60-9979-4b9a6dc11164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:40.693930 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 221/432] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:40.718727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501e177-9c4f-4eb6-b021-79acd7e35dbf None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:40.731235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501e177-9c4f-4eb6-b021-79acd7e35dbf None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:40.736217 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba2053-34bb-42f5-b6d2-691ba00c88fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:40.737021 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba2053-34bb-42f5-b6d2-691ba00c88fe admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:40.737299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba2053-34bb-42f5-b6d2-691ba00c88fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:40.737573 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba2053-34bb-42f5-b6d2-691ba00c88fe admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:40.748498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba2053-34bb-42f5-b6d2-691ba00c88fe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:40.756400 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-1eba2053-34bb-42f5-b6d2-691ba00c88fe admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:40.757774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 212/433] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:40.763281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c58006-069f-4b60-9979-4b9a6dc11164 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:40.773836 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c58006-069f-4b60-9979-4b9a6dc11164 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:40.778735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38783aea-10e1-4016-a359-da2f18e69208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:40.779388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38783aea-10e1-4016-a359-da2f18e69208 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:40.779704 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38783aea-10e1-4016-a359-da2f18e69208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:40.779941 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38783aea-10e1-4016-a359-da2f18e69208 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:40.781568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38783aea-10e1-4016-a359-da2f18e69208 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:40.781879 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38783aea-10e1-4016-a359-da2f18e69208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:40.783464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38783aea-10e1-4016-a359-da2f18e69208 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:40.792531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 222/434] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:40.799041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba2053-34bb-42f5-b6d2-691ba00c88fe admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:40.809958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba2053-34bb-42f5-b6d2-691ba00c88fe admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:40.815196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6a3e9-2476-4fee-a03f-8728bb7c1d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:40.815823 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a3e9-2476-4fee-a03f-8728bb7c1d9b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:40.816124 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a3e9-2476-4fee-a03f-8728bb7c1d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:40.816393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6a3e9-2476-4fee-a03f-8728bb7c1d9b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:40.824930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6a3e9-2476-4fee-a03f-8728bb7c1d9b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:40.826700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6a3e9-2476-4fee-a03f-8728bb7c1d9b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:40.837066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 213/435] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:40.842618 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38783aea-10e1-4016-a359-da2f18e69208 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:40.853551 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38783aea-10e1-4016-a359-da2f18e69208 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:40.859356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb3171-83c7-45ea-9994-3fd10f4ecceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:40.860312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb3171-83c7-45ea-9994-3fd10f4ecceb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:40.860593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb3171-83c7-45ea-9994-3fd10f4ecceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:40.860864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb3171-83c7-45ea-9994-3fd10f4ecceb admin admin] PATH_INFO: `/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:40.862185 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb3171-83c7-45ea-9994-3fd10f4ecceb admin admin] RBAC: Authorizing `identity:get_project(project_id=6e4c6aee6cbf4b47a2e830ac2a40d6ba)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:40.864331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cb3171-83c7-45ea-9994-3fd10f4ecceb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:40.866568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 223/436] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:40 2022] GET /identity/v3/projects/6e4c6aee6cbf4b47a2e830ac2a40d6ba => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:40.872980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6a3e9-2476-4fee-a03f-8728bb7c1d9b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:40.883077 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6a3e9-2476-4fee-a03f-8728bb7c1d9b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:40.889055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518aabb-a115-417e-b6f3-c871a2d0b44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:40.891062 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518aabb-a115-417e-b6f3-c871a2d0b44e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:40.891534 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518aabb-a115-417e-b6f3-c871a2d0b44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:40.892139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518aabb-a115-417e-b6f3-c871a2d0b44e admin admin] PATH_INFO: `/v3/groups/acf2887dc79743b798eda4b7d8d7e948` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:40.893522 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518aabb-a115-417e-b6f3-c871a2d0b44e admin admin] RBAC: Authorizing `identity:get_group(group_id=acf2887dc79743b798eda4b7d8d7e948)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:40.895666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518aabb-a115-417e-b6f3-c871a2d0b44e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:40.897763 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 214/437] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:40 2022] GET /identity/v3/groups/acf2887dc79743b798eda4b7d8d7e948 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:40.903655 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb3171-83c7-45ea-9994-3fd10f4ecceb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:40.914184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb3171-83c7-45ea-9994-3fd10f4ecceb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:40.918441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b663a6-1c29-4d8f-85ef-b77e6ec64ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:40.919077 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b663a6-1c29-4d8f-85ef-b77e6ec64ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:40.919360 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b663a6-1c29-4d8f-85ef-b77e6ec64ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:40.919636 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b663a6-1c29-4d8f-85ef-b77e6ec64ef6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:40.920565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b663a6-1c29-4d8f-85ef-b77e6ec64ef6 admin admin] RBAC: Adding query filter params (group.id=acf2887dc79743b798eda4b7d8d7e948, role.id=34d194b1309f45d9a8ad70d08ccb4230, scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:40.920880 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b663a6-1c29-4d8f-85ef-b77e6ec64ef6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:40.923737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b663a6-1c29-4d8f-85ef-b77e6ec64ef6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:40.929965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 224/438] 10.222.0.90 () {56 vars in 1397 bytes} [Wed Feb 16 09:14:40 2022] GET /identity/v3/role_assignments?group.id=acf2887dc79743b798eda4b7d8d7e948&scope.project.id=6e4c6aee6cbf4b47a2e830ac2a40d6ba&role.id=34d194b1309f45d9a8ad70d08ccb4230 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:40.969159 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66697-13da-4896-86a6-2b7157ca6123 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:40.969649 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66697-13da-4896-86a6-2b7157ca6123 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:40.969978 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed66697-13da-4896-86a6-2b7157ca6123 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:40.971996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 215/439] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:40.977566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f9b50-9c4c-497e-908b-c6c6bec6cf50 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:40.977852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f9b50-9c4c-497e-908b-c6c6bec6cf50 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:40.978127 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f9b50-9c4c-497e-908b-c6c6bec6cf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:40.997637 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-013f9b50-9c4c-497e-908b-c6c6bec6cf50 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:40.998842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-013f9b50-9c4c-497e-908b-c6c6bec6cf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:41.007617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 225/440] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:41.037182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed66697-13da-4896-86a6-2b7157ca6123 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:41.050312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed66697-13da-4896-86a6-2b7157ca6123 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:41.054507 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce1c82-ca36-44ab-991a-c147ee361e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:41.055310 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce1c82-ca36-44ab-991a-c147ee361e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:41.055583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce1c82-ca36-44ab-991a-c147ee361e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:41.055845 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce1c82-ca36-44ab-991a-c147ee361e01 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:41.068010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce1c82-ca36-44ab-991a-c147ee361e01 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:41.075337 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-b5ce1c82-ca36-44ab-991a-c147ee361e01 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:41.076790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 216/441] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:41.082781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f9b50-9c4c-497e-908b-c6c6bec6cf50 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:41.092091 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f9b50-9c4c-497e-908b-c6c6bec6cf50 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:41.098150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec650608-650c-4c6b-a67c-1b4df45b7e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:41.098907 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec650608-650c-4c6b-a67c-1b4df45b7e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:41.099255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec650608-650c-4c6b-a67c-1b4df45b7e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:41.099600 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec650608-650c-4c6b-a67c-1b4df45b7e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:41.100459 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec650608-650c-4c6b-a67c-1b4df45b7e89 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:41.100830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec650608-650c-4c6b-a67c-1b4df45b7e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:41.102524 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec650608-650c-4c6b-a67c-1b4df45b7e89 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:41.113054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 226/442] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:41.118127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce1c82-ca36-44ab-991a-c147ee361e01 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:41.128950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce1c82-ca36-44ab-991a-c147ee361e01 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:41.134071 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078513f9-bf08-4700-a2e9-b3a5c9906362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:41.134704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078513f9-bf08-4700-a2e9-b3a5c9906362 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:41.134981 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078513f9-bf08-4700-a2e9-b3a5c9906362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:41.135253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078513f9-bf08-4700-a2e9-b3a5c9906362 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:41.145450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078513f9-bf08-4700-a2e9-b3a5c9906362 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:41.147205 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078513f9-bf08-4700-a2e9-b3a5c9906362 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:41.157715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 217/443] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:41.163073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec650608-650c-4c6b-a67c-1b4df45b7e89 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:41.173498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec650608-650c-4c6b-a67c-1b4df45b7e89 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:41.178216 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fb070-862f-41c2-b9d9-75e9078a8593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:41.179055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fb070-862f-41c2-b9d9-75e9078a8593 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:41.179339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fb070-862f-41c2-b9d9-75e9078a8593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:41.179623 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fb070-862f-41c2-b9d9-75e9078a8593 admin admin] PATH_INFO: `/v3/projects/ac4c94add81c409d847b103179d99972` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:41.180816 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fb070-862f-41c2-b9d9-75e9078a8593 admin admin] RBAC: Authorizing `identity:get_project(project_id=ac4c94add81c409d847b103179d99972)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:41.182870 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fb070-862f-41c2-b9d9-75e9078a8593 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:41.184559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 227/444] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:41 2022] GET /identity/v3/projects/ac4c94add81c409d847b103179d99972 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:41.190880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078513f9-bf08-4700-a2e9-b3a5c9906362 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:41.199808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078513f9-bf08-4700-a2e9-b3a5c9906362 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:41.205103 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70ca7e-8bc7-4316-ac9e-ce437abf3429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:41.205952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ca7e-8bc7-4316-ac9e-ce437abf3429 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:41.206233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ca7e-8bc7-4316-ac9e-ce437abf3429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:41.206506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ca7e-8bc7-4316-ac9e-ce437abf3429 admin admin] PATH_INFO: `/v3/groups/acf2887dc79743b798eda4b7d8d7e948` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:41.207668 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70ca7e-8bc7-4316-ac9e-ce437abf3429 admin admin] RBAC: Authorizing `identity:get_group(group_id=acf2887dc79743b798eda4b7d8d7e948)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:41.209598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70ca7e-8bc7-4316-ac9e-ce437abf3429 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:41.211357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 218/445] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:41 2022] GET /identity/v3/groups/acf2887dc79743b798eda4b7d8d7e948 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:41.216867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fb070-862f-41c2-b9d9-75e9078a8593 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:41.229694 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fb070-862f-41c2-b9d9-75e9078a8593 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:41.234902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a20623-33c4-45d5-8822-93d5184cc703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:41.235540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a20623-33c4-45d5-8822-93d5184cc703 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:41.235822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a20623-33c4-45d5-8822-93d5184cc703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:41.236124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a20623-33c4-45d5-8822-93d5184cc703 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:41.236953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a20623-33c4-45d5-8822-93d5184cc703 admin admin] RBAC: Adding query filter params (group.id=acf2887dc79743b798eda4b7d8d7e948, role.id=34d194b1309f45d9a8ad70d08ccb4230, scope.project.id=ac4c94add81c409d847b103179d99972) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:41.237266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a20623-33c4-45d5-8822-93d5184cc703 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:41.239099 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a20623-33c4-45d5-8822-93d5184cc703 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:41.245932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 228/446] 10.222.0.90 () {56 vars in 1397 bytes} [Wed Feb 16 09:14:41 2022] GET /identity/v3/role_assignments?group.id=acf2887dc79743b798eda4b7d8d7e948&scope.project.id=ac4c94add81c409d847b103179d99972&role.id=34d194b1309f45d9a8ad70d08ccb4230 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:42.064661 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b121-c6f9-4a5f-8635-3972d108a1f0 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:42.065185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b121-c6f9-4a5f-8635-3972d108a1f0 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:42.065185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b121-c6f9-4a5f-8635-3972d108a1f0 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:42.066968 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 219/447] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:42.071975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cdca9-3885-44d4-862e-6eb1ad514922 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:42.072376 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cdca9-3885-44d4-862e-6eb1ad514922 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:42.072543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cdca9-3885-44d4-862e-6eb1ad514922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:42.089805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d86cdca9-3885-44d4-862e-6eb1ad514922 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:42.090963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d86cdca9-3885-44d4-862e-6eb1ad514922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:42.098914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 229/448] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:42.123404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b121-c6f9-4a5f-8635-3972d108a1f0 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:42.135327 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b121-c6f9-4a5f-8635-3972d108a1f0 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:42.139469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033da38-6043-449f-84ee-c8ec531c803b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:42.140773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033da38-6043-449f-84ee-c8ec531c803b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:42.141055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033da38-6043-449f-84ee-c8ec531c803b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:42.141327 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033da38-6043-449f-84ee-c8ec531c803b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:42.151202 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033da38-6043-449f-84ee-c8ec531c803b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:42.158645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-c033da38-6043-449f-84ee-c8ec531c803b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:14:42.159767 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 220/449] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:14:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:42.165052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cdca9-3885-44d4-862e-6eb1ad514922 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:42.174809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cdca9-3885-44d4-862e-6eb1ad514922 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:42.179068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72720ef-1434-47f3-8e52-1d1bffd62843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:42.179706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72720ef-1434-47f3-8e52-1d1bffd62843 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:42.180367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72720ef-1434-47f3-8e52-1d1bffd62843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:42.180649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72720ef-1434-47f3-8e52-1d1bffd62843 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:42.181389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72720ef-1434-47f3-8e52-1d1bffd62843 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:42.181690 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72720ef-1434-47f3-8e52-1d1bffd62843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:42.183291 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72720ef-1434-47f3-8e52-1d1bffd62843 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:42.191799 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 230/450] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:42.196770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033da38-6043-449f-84ee-c8ec531c803b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:42.207048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033da38-6043-449f-84ee-c8ec531c803b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:42.211347 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3a6ca-a73a-404b-a0d4-8bb95d8966c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:42.211952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3a6ca-a73a-404b-a0d4-8bb95d8966c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:42.212262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3a6ca-a73a-404b-a0d4-8bb95d8966c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:42.212542 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3a6ca-a73a-404b-a0d4-8bb95d8966c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:42.221686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3a6ca-a73a-404b-a0d4-8bb95d8966c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:42.223412 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3a6ca-a73a-404b-a0d4-8bb95d8966c9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:42.231953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 221/451] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:42.237304 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72720ef-1434-47f3-8e52-1d1bffd62843 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:42.246408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72720ef-1434-47f3-8e52-1d1bffd62843 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:42.251944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce6a31-d3e5-465d-9eb9-dd399912770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:42.252796 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6a31-d3e5-465d-9eb9-dd399912770c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:42.253077 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6a31-d3e5-465d-9eb9-dd399912770c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:42.253347 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6a31-d3e5-465d-9eb9-dd399912770c admin admin] PATH_INFO: `/v3/projects/452aa210ed214b4b8bc6178a127c766b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:42.254506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce6a31-d3e5-465d-9eb9-dd399912770c admin admin] RBAC: Authorizing `identity:get_project(project_id=452aa210ed214b4b8bc6178a127c766b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:42.256307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce6a31-d3e5-465d-9eb9-dd399912770c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:42.257925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 231/452] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:14:42 2022] GET /identity/v3/projects/452aa210ed214b4b8bc6178a127c766b => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:42.262994 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3a6ca-a73a-404b-a0d4-8bb95d8966c9 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:42.272314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3a6ca-a73a-404b-a0d4-8bb95d8966c9 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:42.276601 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11c6cb-122d-4f2a-ab09-6a27a2c32ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:42.277413 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11c6cb-122d-4f2a-ab09-6a27a2c32ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:42.277690 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11c6cb-122d-4f2a-ab09-6a27a2c32ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:42.277959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11c6cb-122d-4f2a-ab09-6a27a2c32ee0 admin admin] PATH_INFO: `/v3/groups/390c23a209ed44619170d750d9172509` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:42.279104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11c6cb-122d-4f2a-ab09-6a27a2c32ee0 admin admin] RBAC: Authorizing `identity:get_group(group_id=390c23a209ed44619170d750d9172509)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:42.281631 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11c6cb-122d-4f2a-ab09-6a27a2c32ee0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:42.283179 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 222/453] 10.222.0.90 () {56 vars in 1201 bytes} [Wed Feb 16 09:14:42 2022] GET /identity/v3/groups/390c23a209ed44619170d750d9172509 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:42.288313 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce6a31-d3e5-465d-9eb9-dd399912770c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:42.297549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce6a31-d3e5-465d-9eb9-dd399912770c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:42.301747 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa51a09-0946-45ba-b41b-bdbc6a393bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:42.302349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa51a09-0946-45ba-b41b-bdbc6a393bbe admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:42.302625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa51a09-0946-45ba-b41b-bdbc6a393bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:42.302893 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa51a09-0946-45ba-b41b-bdbc6a393bbe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:42.303692 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa51a09-0946-45ba-b41b-bdbc6a393bbe admin admin] RBAC: Adding query filter params (group.id=390c23a209ed44619170d750d9172509, role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=452aa210ed214b4b8bc6178a127c766b) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:42.303992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa51a09-0946-45ba-b41b-bdbc6a393bbe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:42.305804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa51a09-0946-45ba-b41b-bdbc6a393bbe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:42.311265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 232/454] 10.222.0.90 () {56 vars in 1397 bytes} [Wed Feb 16 09:14:42 2022] GET /identity/v3/role_assignments?group.id=390c23a209ed44619170d750d9172509&scope.project.id=452aa210ed214b4b8bc6178a127c766b&role.id=0e45946c6336419abb2015d8916e31ca => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:45.133785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cc4ab-0fce-4466-82d2-26c2872f0e87 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.134833 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cc4ab-0fce-4466-82d2-26c2872f0e87 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.135332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cc4ab-0fce-4466-82d2-26c2872f0e87 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.137791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 223/455] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:45.144331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aef6dc-2ac7-4a1b-8cef-9e06b6ebcc5d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.145298 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aef6dc-2ac7-4a1b-8cef-9e06b6ebcc5d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.145765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aef6dc-2ac7-4a1b-8cef-9e06b6ebcc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.166438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e4aef6dc-2ac7-4a1b-8cef-9e06b6ebcc5d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:45.168011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e4aef6dc-2ac7-4a1b-8cef-9e06b6ebcc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:45.182225 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 233/456] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:45.211759 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cc4ab-0fce-4466-82d2-26c2872f0e87 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:45.229866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cc4ab-0fce-4466-82d2-26c2872f0e87 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:45.235177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526d553-08bc-4284-bef8-cec7abd7cec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:45.236205 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526d553-08bc-4284-bef8-cec7abd7cec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.236678 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526d553-08bc-4284-bef8-cec7abd7cec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.237169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526d553-08bc-4284-bef8-cec7abd7cec8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.253353 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526d553-08bc-4284-bef8-cec7abd7cec8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:45.255470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526d553-08bc-4284-bef8-cec7abd7cec8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:45.276050 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-7526d553-08bc-4284-bef8-cec7abd7cec8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:45.277823 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 224/457] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:45.283932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aef6dc-2ac7-4a1b-8cef-9e06b6ebcc5d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:45.293126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aef6dc-2ac7-4a1b-8cef-9e06b6ebcc5d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:45.298658 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b609b6-7b34-4330-986a-55627e61fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:45.299543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b609b6-7b34-4330-986a-55627e61fa94 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.300015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b609b6-7b34-4330-986a-55627e61fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.300572 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b609b6-7b34-4330-986a-55627e61fa94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.301483 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b609b6-7b34-4330-986a-55627e61fa94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:45.301985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b609b6-7b34-4330-986a-55627e61fa94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:45.303187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-33b609b6-7b34-4330-986a-55627e61fa94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:45.303187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:14:45.303187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:14:45.304443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b609b6-7b34-4330-986a-55627e61fa94 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:45.331316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 234/458] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:45.337056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526d553-08bc-4284-bef8-cec7abd7cec8 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:45.349173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526d553-08bc-4284-bef8-cec7abd7cec8 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:45.353753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76f937-aa4b-4769-89b5-240d5da128ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:45.354660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76f937-aa4b-4769-89b5-240d5da128ec admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.355133 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76f937-aa4b-4769-89b5-240d5da128ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.355596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76f937-aa4b-4769-89b5-240d5da128ec admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.356515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76f937-aa4b-4769-89b5-240d5da128ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:45.359154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76f937-aa4b-4769-89b5-240d5da128ec admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:45.363501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf18537-dd70-42fe-a748-367dbc68a6be None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.364010 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf18537-dd70-42fe-a748-367dbc68a6be None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.364500 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf18537-dd70-42fe-a748-367dbc68a6be None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.366424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 235/459] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:45.376058 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c70c6-68d4-439b-b152-4a5d31df576a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.376058 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c70c6-68d4-439b-b152-4a5d31df576a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.376058 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c70c6-68d4-439b-b152-4a5d31df576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.399699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1b7c70c6-68d4-439b-b152-4a5d31df576a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:45.402398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 225/460] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:14:45 2022] POST /identity/v3/users => generated 246 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:45.402581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1b7c70c6-68d4-439b-b152-4a5d31df576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:45.418913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 236/461] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:45.445023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76f937-aa4b-4769-89b5-240d5da128ec admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:45.455649 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76f937-aa4b-4769-89b5-240d5da128ec admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:45.464434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb128b-0c23-4c7b-ad40-7919c5abf100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:45.465233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb128b-0c23-4c7b-ad40-7919c5abf100 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.465509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb128b-0c23-4c7b-ad40-7919c5abf100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.465778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb128b-0c23-4c7b-ad40-7919c5abf100 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.483355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb128b-0c23-4c7b-ad40-7919c5abf100 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:45.485388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb128b-0c23-4c7b-ad40-7919c5abf100 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:45.513944 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-02eb128b-0c23-4c7b-ad40-7919c5abf100 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:45.516507 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 226/462] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:45.521953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c70c6-68d4-439b-b152-4a5d31df576a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:45.534458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c70c6-68d4-439b-b152-4a5d31df576a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:45.542189 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cdfd1-b603-42cf-9a47-adaa40de4cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:45.542856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cdfd1-b603-42cf-9a47-adaa40de4cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.543133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cdfd1-b603-42cf-9a47-adaa40de4cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.543401 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cdfd1-b603-42cf-9a47-adaa40de4cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.544144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cdfd1-b603-42cf-9a47-adaa40de4cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:45.544446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cdfd1-b603-42cf-9a47-adaa40de4cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:45.546039 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cdfd1-b603-42cf-9a47-adaa40de4cb7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:45.560612 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 237/463] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:45.566888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb128b-0c23-4c7b-ad40-7919c5abf100 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:45.576703 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb128b-0c23-4c7b-ad40-7919c5abf100 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:45.584095 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3785f-2671-4e53-b7b4-60bfaff5f0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:45.584767 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3785f-2671-4e53-b7b4-60bfaff5f0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.585041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3785f-2671-4e53-b7b4-60bfaff5f0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.585313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3785f-2671-4e53-b7b4-60bfaff5f0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.586025 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3785f-2671-4e53-b7b4-60bfaff5f0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:45.587932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3785f-2671-4e53-b7b4-60bfaff5f0e4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:45.623846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47fa6-552a-46d3-a6dc-086bc5c94d57 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.624779 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47fa6-552a-46d3-a6dc-086bc5c94d57 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.625005 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47fa6-552a-46d3-a6dc-086bc5c94d57 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.627642 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 238/464] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:45.634233 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad945f9-4c94-44c1-b225-3d14d1f30fae None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.634542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad945f9-4c94-44c1-b225-3d14d1f30fae None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.634789 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad945f9-4c94-44c1-b225-3d14d1f30fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.636703 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 227/465] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:14:45 2022] POST /identity/v3/users => generated 248 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:45.666876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-dad945f9-4c94-44c1-b225-3d14d1f30fae None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:45.668154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-dad945f9-4c94-44c1-b225-3d14d1f30fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:45.677983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 239/466] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:45.730447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3785f-2671-4e53-b7b4-60bfaff5f0e4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:45.741596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3785f-2671-4e53-b7b4-60bfaff5f0e4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:45.746699 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45498d-18be-493b-9884-61d35d8501e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:45.747514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45498d-18be-493b-9884-61d35d8501e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.747795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45498d-18be-493b-9884-61d35d8501e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.748094 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45498d-18be-493b-9884-61d35d8501e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.762128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45498d-18be-493b-9884-61d35d8501e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:45.764055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45498d-18be-493b-9884-61d35d8501e8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:45.783209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-6a45498d-18be-493b-9884-61d35d8501e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:45.785094 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 228/467] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:45.790567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad945f9-4c94-44c1-b225-3d14d1f30fae None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:45.800106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad945f9-4c94-44c1-b225-3d14d1f30fae None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:45.805638 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dfa71-c03a-4a18-a98c-f7e735e5418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:45.806406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dfa71-c03a-4a18-a98c-f7e735e5418f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.806756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dfa71-c03a-4a18-a98c-f7e735e5418f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.807093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dfa71-c03a-4a18-a98c-f7e735e5418f admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.807900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dfa71-c03a-4a18-a98c-f7e735e5418f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:45.809938 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dfa71-c03a-4a18-a98c-f7e735e5418f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:45.811650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dfa71-c03a-4a18-a98c-f7e735e5418f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:45.825439 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 240/468] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:45.831885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45498d-18be-493b-9884-61d35d8501e8 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:45.842575 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45498d-18be-493b-9884-61d35d8501e8 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:45.848372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a1d1d-f546-42f0-a066-40b0ae38f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:45.849323 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1d1d-f546-42f0-a066-40b0ae38f413 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:45.849782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1d1d-f546-42f0-a066-40b0ae38f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:45.850254 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1d1d-f546-42f0-a066-40b0ae38f413 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:45.851194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a1d1d-f546-42f0-a066-40b0ae38f413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:45.853408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a1d1d-f546-42f0-a066-40b0ae38f413 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:45.881939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 229/469] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:14:45 2022] POST /identity/v3/users => generated 248 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:46.044583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21134e-7eb9-4dba-9a28-18ff89d38576 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:46.044874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21134e-7eb9-4dba-9a28-18ff89d38576 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:46.045069 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21134e-7eb9-4dba-9a28-18ff89d38576 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:46.047401 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 241/470] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:46.053907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6e82f-fca2-430c-8129-8e53d68ec6c4 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:46.054332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6e82f-fca2-430c-8129-8e53d68ec6c4 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:46.054742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6e82f-fca2-430c-8129-8e53d68ec6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:46.084130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-26e6e82f-fca2-430c-8129-8e53d68ec6c4 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:46.085330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-26e6e82f-fca2-430c-8129-8e53d68ec6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:46.095856 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 230/471] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:46.122771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21134e-7eb9-4dba-9a28-18ff89d38576 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:46.137913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21134e-7eb9-4dba-9a28-18ff89d38576 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:46.143371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0dcf9-9f89-430a-adbe-044816b726d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:46.144282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0dcf9-9f89-430a-adbe-044816b726d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:46.144562 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0dcf9-9f89-430a-adbe-044816b726d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:46.145122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0dcf9-9f89-430a-adbe-044816b726d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:46.158565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0dcf9-9f89-430a-adbe-044816b726d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:46.160298 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0dcf9-9f89-430a-adbe-044816b726d3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:46.178834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-ecd0dcf9-9f89-430a-adbe-044816b726d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:46.180416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 242/472] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:46.186061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6e82f-fca2-430c-8129-8e53d68ec6c4 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:46.196570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6e82f-fca2-430c-8129-8e53d68ec6c4 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:46.201099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54894c4-fe93-4869-9dfe-ceb6b12b173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:46.201750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54894c4-fe93-4869-9dfe-ceb6b12b173c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:46.202082 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54894c4-fe93-4869-9dfe-ceb6b12b173c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:46.202350 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54894c4-fe93-4869-9dfe-ceb6b12b173c admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:46.203147 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54894c4-fe93-4869-9dfe-ceb6b12b173c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:46.203418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54894c4-fe93-4869-9dfe-ceb6b12b173c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:46.205152 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54894c4-fe93-4869-9dfe-ceb6b12b173c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:46.218181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 231/473] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:46.223502 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0dcf9-9f89-430a-adbe-044816b726d3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:46.233293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0dcf9-9f89-430a-adbe-044816b726d3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:46.238588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d078dc-3925-463a-b7c6-df343cbd87e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:46.239239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d078dc-3925-463a-b7c6-df343cbd87e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:46.239568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d078dc-3925-463a-b7c6-df343cbd87e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:46.239842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d078dc-3925-463a-b7c6-df343cbd87e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:46.240592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d078dc-3925-463a-b7c6-df343cbd87e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:46.242580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d078dc-3925-463a-b7c6-df343cbd87e7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:46.268657 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 243/474] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:14:46 2022] POST /identity/v3/users => generated 249 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:46.536198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b3d46-5958-4617-87c1-036a1eb6d696 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:46.536592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b3d46-5958-4617-87c1-036a1eb6d696 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:46.536769 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b3d46-5958-4617-87c1-036a1eb6d696 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:46.538508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 232/475] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:46.543945 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa7f38-1c17-40c8-a1b2-1f2fedcc5fe2 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:46.544263 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa7f38-1c17-40c8-a1b2-1f2fedcc5fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:46.544546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa7f38-1c17-40c8-a1b2-1f2fedcc5fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:46.567659 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c3aa7f38-1c17-40c8-a1b2-1f2fedcc5fe2 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:46.568874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c3aa7f38-1c17-40c8-a1b2-1f2fedcc5fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:46.581349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 244/476] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:46.605565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b3d46-5958-4617-87c1-036a1eb6d696 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:46.622263 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b3d46-5958-4617-87c1-036a1eb6d696 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:46.627864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce0f4b-0ad3-4879-b7f5-c2ecb26df6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:46.628548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0f4b-0ad3-4879-b7f5-c2ecb26df6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:46.628831 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0f4b-0ad3-4879-b7f5-c2ecb26df6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:46.629107 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce0f4b-0ad3-4879-b7f5-c2ecb26df6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:46.629905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce0f4b-0ad3-4879-b7f5-c2ecb26df6e5 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:46.631612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce0f4b-0ad3-4879-b7f5-c2ecb26df6e5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:46.643256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.sql.core [None req-b2ce0f4b-0ad3-4879-b7f5-c2ecb26df6e5 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 16 09:14:46.643256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 16 09:14:46.643256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [parameters: {'id': 'ccc2086bb36a44c6a8a57034fc8e52bb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 16 09:14:46.643256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79275) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 16 09:14:46.661226 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-b2ce0f4b-0ad3-4879-b7f5-c2ecb26df6e5 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 16 09:14:46.662623 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 233/477] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:14:46 2022] POST /identity/v3/roles => generated 144 bytes in 58 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:46.668507 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa7f38-1c17-40c8-a1b2-1f2fedcc5fe2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:46.680092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa7f38-1c17-40c8-a1b2-1f2fedcc5fe2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:46.684797 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce411541-0ad3-4591-a2cc-ddbbde97d5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:46.685590 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce411541-0ad3-4591-a2cc-ddbbde97d5aa admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:46.685935 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce411541-0ad3-4591-a2cc-ddbbde97d5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:46.686138 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce411541-0ad3-4591-a2cc-ddbbde97d5aa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:46.698614 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce411541-0ad3-4591-a2cc-ddbbde97d5aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:46.707027 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-ce411541-0ad3-4591-a2cc-ddbbde97d5aa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 09:14:46.708701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 245/478] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:14:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:46.714518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce0f4b-0ad3-4879-b7f5-c2ecb26df6e5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:46.730826 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce0f4b-0ad3-4879-b7f5-c2ecb26df6e5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:46.737584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2197b6-cd54-4b45-9117-c820cb54dfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:46.738597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2197b6-cd54-4b45-9117-c820cb54dfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:46.739012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2197b6-cd54-4b45-9117-c820cb54dfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:46.739475 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2197b6-cd54-4b45-9117-c820cb54dfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:46.740802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2197b6-cd54-4b45-9117-c820cb54dfd6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:46.741260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2197b6-cd54-4b45-9117-c820cb54dfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:46.743891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2197b6-cd54-4b45-9117-c820cb54dfd6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:46.757176 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 234/479] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:48.426871 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9d11d-b1c0-4a4a-b0df-6f533c3b8c73 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.427407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9d11d-b1c0-4a4a-b0df-6f533c3b8c73 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.427407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9d11d-b1c0-4a4a-b0df-6f533c3b8c73 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.429414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 246/480] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:48.434875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320aa975-b921-469f-9cae-43837eba1fa2 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.435286 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320aa975-b921-469f-9cae-43837eba1fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.435475 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320aa975-b921-469f-9cae-43837eba1fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.460310 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-320aa975-b921-469f-9cae-43837eba1fa2 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:48.461490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-320aa975-b921-469f-9cae-43837eba1fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:48.475438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 235/481] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:48.510803 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9d11d-b1c0-4a4a-b0df-6f533c3b8c73 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:48.524205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9d11d-b1c0-4a4a-b0df-6f533c3b8c73 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:48.535582 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa587a5-c5da-4dd8-8b7d-6ec13b994ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:48.536395 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa587a5-c5da-4dd8-8b7d-6ec13b994ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.536672 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa587a5-c5da-4dd8-8b7d-6ec13b994ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.536938 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa587a5-c5da-4dd8-8b7d-6ec13b994ed4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.548388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa587a5-c5da-4dd8-8b7d-6ec13b994ed4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:48.559254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-ffa587a5-c5da-4dd8-8b7d-6ec13b994ed4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:48.560782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 247/482] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:48.566722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320aa975-b921-469f-9cae-43837eba1fa2 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:48.575768 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320aa975-b921-469f-9cae-43837eba1fa2 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:48.581060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7b953-0e1a-4ddc-823d-d82ff2a66168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:48.581727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7b953-0e1a-4ddc-823d-d82ff2a66168 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.582003 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7b953-0e1a-4ddc-823d-d82ff2a66168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.582285 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7b953-0e1a-4ddc-823d-d82ff2a66168 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.583012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7b953-0e1a-4ddc-823d-d82ff2a66168 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:48.583314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7b953-0e1a-4ddc-823d-d82ff2a66168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:48.584923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7b953-0e1a-4ddc-823d-d82ff2a66168 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:48.600347 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 236/483] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:48.601646 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa587a5-c5da-4dd8-8b7d-6ec13b994ed4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:48.615969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa587a5-c5da-4dd8-8b7d-6ec13b994ed4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:48.620450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd30a4-2c1b-4547-b9d4-8e6d75304cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:48.621222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd30a4-2c1b-4547-b9d4-8e6d75304cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.621499 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd30a4-2c1b-4547-b9d4-8e6d75304cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.621771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd30a4-2c1b-4547-b9d4-8e6d75304cd8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.639076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd30a4-2c1b-4547-b9d4-8e6d75304cd8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:48.641802 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd30a4-2c1b-4547-b9d4-8e6d75304cd8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:48.658930 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-1dcd30a4-2c1b-4547-b9d4-8e6d75304cd8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:48.660485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 248/484] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:48.665607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7b953-0e1a-4ddc-823d-d82ff2a66168 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:48.682492 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7b953-0e1a-4ddc-823d-d82ff2a66168 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:48.693126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f21580-7270-424e-b95a-ba5b11d14476 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.693496 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f21580-7270-424e-b95a-ba5b11d14476 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.693847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f21580-7270-424e-b95a-ba5b11d14476 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.696465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 249/485] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:48.696848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb4bee-4344-4348-b580-fc526c53183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:48.697681 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb4bee-4344-4348-b580-fc526c53183f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.698176 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb4bee-4344-4348-b580-fc526c53183f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.698594 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb4bee-4344-4348-b580-fc526c53183f admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.699461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb4bee-4344-4348-b580-fc526c53183f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:48.699911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb4bee-4344-4348-b580-fc526c53183f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:48.701700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb4bee-4344-4348-b580-fc526c53183f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:48.703281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463375a-56a0-49e2-a9c5-df4520d9d7dc None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.703658 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463375a-56a0-49e2-a9c5-df4520d9d7dc None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.704040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463375a-56a0-49e2-a9c5-df4520d9d7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.722305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c463375a-56a0-49e2-a9c5-df4520d9d7dc None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:48.722766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 237/486] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:48.725736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c463375a-56a0-49e2-a9c5-df4520d9d7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:48.727704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb4bee-4344-4348-b580-fc526c53183f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:48.732011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 250/487] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:48.741087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb4bee-4344-4348-b580-fc526c53183f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:48.757559 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f1710-adfc-4426-9498-a0fce49df55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:48.757925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463375a-56a0-49e2-a9c5-df4520d9d7dc None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:48.758365 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f1710-adfc-4426-9498-a0fce49df55b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.758643 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f1710-adfc-4426-9498-a0fce49df55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.758912 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f1710-adfc-4426-9498-a0fce49df55b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.768942 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463375a-56a0-49e2-a9c5-df4520d9d7dc None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:48.772898 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f1710-adfc-4426-9498-a0fce49df55b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:48.773942 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd273b-b328-4fdc-805d-7c7cb3451417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:48.774923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f1710-adfc-4426-9498-a0fce49df55b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:48.775193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd273b-b328-4fdc-805d-7c7cb3451417 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.775721 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd273b-b328-4fdc-805d-7c7cb3451417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.776228 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd273b-b328-4fdc-805d-7c7cb3451417 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.787257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd273b-b328-4fdc-805d-7c7cb3451417 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:48.798570 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-37cd273b-b328-4fdc-805d-7c7cb3451417 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:48.800071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 251/488] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:48.801415 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-aa5f1710-adfc-4426-9498-a0fce49df55b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 09:14:48.807497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 238/489] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Feb 16 09:14:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:48.808722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd273b-b328-4fdc-805d-7c7cb3451417 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:48.815224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f1710-adfc-4426-9498-a0fce49df55b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:48.825979 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd273b-b328-4fdc-805d-7c7cb3451417 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:48.830887 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f1710-adfc-4426-9498-a0fce49df55b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:48.837147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0a3c3-d73b-43a3-bab1-14ad14e029d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:48.838475 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0a3c3-d73b-43a3-bab1-14ad14e029d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.839780 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0a3c3-d73b-43a3-bab1-14ad14e029d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.840530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc2281-fc68-42e1-82d1-1037c1714678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:48.841042 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0a3c3-d73b-43a3-bab1-14ad14e029d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.841995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0a3c3-d73b-43a3-bab1-14ad14e029d7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:48.842827 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc2281-fc68-42e1-82d1-1037c1714678 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.843531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0a3c3-d73b-43a3-bab1-14ad14e029d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:48.844001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc2281-fc68-42e1-82d1-1037c1714678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.844506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc2281-fc68-42e1-82d1-1037c1714678 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.845589 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc2281-fc68-42e1-82d1-1037c1714678 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:48.846081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc2281-fc68-42e1-82d1-1037c1714678 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:48.847095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0a3c3-d73b-43a3-bab1-14ad14e029d7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:48.847473 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-e7fc2281-fc68-42e1-82d1-1037c1714678 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:48.847473 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:14:48.847473 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:14:48.849223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc2281-fc68-42e1-82d1-1037c1714678 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:48.864113 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 252/490] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:48.872867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0a3c3-d73b-43a3-bab1-14ad14e029d7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:48.894079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0a3c3-d73b-43a3-bab1-14ad14e029d7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:48.900121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24849da1-3311-4708-a1d8-0a11cbd4bdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:48.902775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 239/491] 10.222.0.90 () {56 vars in 1154 bytes} [Wed Feb 16 09:14:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:48.903857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24849da1-3311-4708-a1d8-0a11cbd4bdad admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.904372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24849da1-3311-4708-a1d8-0a11cbd4bdad admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.904870 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24849da1-3311-4708-a1d8-0a11cbd4bdad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.908540 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc2281-fc68-42e1-82d1-1037c1714678 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:48.925973 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc2281-fc68-42e1-82d1-1037c1714678 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:48.930963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24849da1-3311-4708-a1d8-0a11cbd4bdad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:48.933852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24849da1-3311-4708-a1d8-0a11cbd4bdad admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:48.935075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c42614-9836-4d88-adcd-0fc2ad799754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:48.935928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c42614-9836-4d88-adcd-0fc2ad799754 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:48.936446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c42614-9836-4d88-adcd-0fc2ad799754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:48.937947 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c42614-9836-4d88-adcd-0fc2ad799754 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:48.956289 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c42614-9836-4d88-adcd-0fc2ad799754 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:48.958378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c42614-9836-4d88-adcd-0fc2ad799754 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:48.965645 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-24849da1-3311-4708-a1d8-0a11cbd4bdad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:48.971068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 253/492] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:48.978197 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24849da1-3311-4708-a1d8-0a11cbd4bdad admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:48.981253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 240/493] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 09:14:48.988956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c42614-9836-4d88-adcd-0fc2ad799754 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.001577 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24849da1-3311-4708-a1d8-0a11cbd4bdad admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.004757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c42614-9836-4d88-adcd-0fc2ad799754 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.018416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8e523-2faf-48f0-903f-7b833f025f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.019936 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e523-2faf-48f0-903f-7b833f025f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.021285 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e523-2faf-48f0-903f-7b833f025f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.022122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12699239-4f4c-4b08-8a92-0145bae27ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.022617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8e523-2faf-48f0-903f-7b833f025f97 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.024004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12699239-4f4c-4b08-8a92-0145bae27ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.025954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12699239-4f4c-4b08-8a92-0145bae27ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.026448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12699239-4f4c-4b08-8a92-0145bae27ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.027383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12699239-4f4c-4b08-8a92-0145bae27ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.028653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12699239-4f4c-4b08-8a92-0145bae27ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.040804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12699239-4f4c-4b08-8a92-0145bae27ef8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.047087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8e523-2faf-48f0-903f-7b833f025f97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.049365 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8e523-2faf-48f0-903f-7b833f025f97 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.054518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 254/494] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.055976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daabff8-c6b7-402c-9c8a-d45147fe04f0 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.060557 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daabff8-c6b7-402c-9c8a-d45147fe04f0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.060989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daabff8-c6b7-402c-9c8a-d45147fe04f0 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.063762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 255/495] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:49.068136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-93a8e523-2faf-48f0-903f-7b833f025f97 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:49.068596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daabff8-c6b7-402c-9c8a-d45147fe04f0 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.069580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 241/496] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:49.070986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996bf0c-f6f6-4596-ad80-ae7bd9959e41 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.071341 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996bf0c-f6f6-4596-ad80-ae7bd9959e41 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.071691 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996bf0c-f6f6-4596-ad80-ae7bd9959e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.083323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daabff8-c6b7-402c-9c8a-d45147fe04f0 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.087872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29067f96-ff3c-4ff6-8c9a-b0fd0a0a5536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.088863 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29067f96-ff3c-4ff6-8c9a-b0fd0a0a5536 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.089306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29067f96-ff3c-4ff6-8c9a-b0fd0a0a5536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.089846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29067f96-ff3c-4ff6-8c9a-b0fd0a0a5536 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.090636 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-c996bf0c-f6f6-4596-ad80-ae7bd9959e41 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:49.092137 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c996bf0c-f6f6-4596-ad80-ae7bd9959e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:49.100416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29067f96-ff3c-4ff6-8c9a-b0fd0a0a5536 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.101651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 242/497] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:49.102581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996bf0c-f6f6-4596-ad80-ae7bd9959e41 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.103175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29067f96-ff3c-4ff6-8c9a-b0fd0a0a5536 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.114112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996bf0c-f6f6-4596-ad80-ae7bd9959e41 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.122730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-29067f96-ff3c-4ff6-8c9a-b0fd0a0a5536 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 16 09:14:49.129788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 256/498] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:49.129788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29067f96-ff3c-4ff6-8c9a-b0fd0a0a5536 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.133300 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe309eec-471e-4fbc-9fb8-52ca1b4f1698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.134498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309eec-471e-4fbc-9fb8-52ca1b4f1698 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.135027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309eec-471e-4fbc-9fb8-52ca1b4f1698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.136131 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309eec-471e-4fbc-9fb8-52ca1b4f1698 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.137371 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309eec-471e-4fbc-9fb8-52ca1b4f1698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.137896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309eec-471e-4fbc-9fb8-52ca1b4f1698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.139205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29067f96-ff3c-4ff6-8c9a-b0fd0a0a5536 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.141221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309eec-471e-4fbc-9fb8-52ca1b4f1698 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.147972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200d8ed-71cd-4cc1-bc77-543fc93fb482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.149127 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200d8ed-71cd-4cc1-bc77-543fc93fb482 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.149407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200d8ed-71cd-4cc1-bc77-543fc93fb482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.149677 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200d8ed-71cd-4cc1-bc77-543fc93fb482 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.155228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 243/499] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.157164 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe309eec-471e-4fbc-9fb8-52ca1b4f1698 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.161734 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200d8ed-71cd-4cc1-bc77-543fc93fb482 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:49.167627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe309eec-471e-4fbc-9fb8-52ca1b4f1698 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.169688 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-3200d8ed-71cd-4cc1-bc77-543fc93fb482 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:49.176073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 257/500] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:49.176073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200d8ed-71cd-4cc1-bc77-543fc93fb482 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.185822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200d8ed-71cd-4cc1-bc77-543fc93fb482 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.193380 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4475d-aea8-4298-8233-afd242deedb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.194217 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4475d-aea8-4298-8233-afd242deedb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.194517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4475d-aea8-4298-8233-afd242deedb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.194802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4475d-aea8-4298-8233-afd242deedb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.195656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4475d-aea8-4298-8233-afd242deedb5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.195951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4475d-aea8-4298-8233-afd242deedb5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.197872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4475d-aea8-4298-8233-afd242deedb5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.204296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c505457-d462-4722-92e7-799aba34ba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.205580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c505457-d462-4722-92e7-799aba34ba4b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.206164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c505457-d462-4722-92e7-799aba34ba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.206634 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c505457-d462-4722-92e7-799aba34ba4b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.215926 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c505457-d462-4722-92e7-799aba34ba4b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.217277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 244/501] 10.222.0.90 () {56 vars in 1158 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.222302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4475d-aea8-4298-8233-afd242deedb5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.223399 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c505457-d462-4722-92e7-799aba34ba4b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.231971 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4475d-aea8-4298-8233-afd242deedb5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.241519 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-6c505457-d462-4722-92e7-799aba34ba4b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:49.242839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 258/502] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:49.243405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51b9c5-4b93-434f-a1df-c2cf33cc7bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.243845 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c505457-d462-4722-92e7-799aba34ba4b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.244788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51b9c5-4b93-434f-a1df-c2cf33cc7bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.245074 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51b9c5-4b93-434f-a1df-c2cf33cc7bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.245375 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51b9c5-4b93-434f-a1df-c2cf33cc7bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.246120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51b9c5-4b93-434f-a1df-c2cf33cc7bc3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.246425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51b9c5-4b93-434f-a1df-c2cf33cc7bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.248048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51b9c5-4b93-434f-a1df-c2cf33cc7bc3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.258919 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c505457-d462-4722-92e7-799aba34ba4b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.259491 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 245/503] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.260725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51b9c5-4b93-434f-a1df-c2cf33cc7bc3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.263705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74044b-c349-40cd-a2c0-cd44bfb73b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.264403 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74044b-c349-40cd-a2c0-cd44bfb73b26 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.264684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74044b-c349-40cd-a2c0-cd44bfb73b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.265804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74044b-c349-40cd-a2c0-cd44bfb73b26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.273129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51b9c5-4b93-434f-a1df-c2cf33cc7bc3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.275071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74044b-c349-40cd-a2c0-cd44bfb73b26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.277385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74044b-c349-40cd-a2c0-cd44bfb73b26 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.278405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5298bc2-e0be-4429-9a96-cb40dbf890cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.279368 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5298bc2-e0be-4429-9a96-cb40dbf890cd admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.279859 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5298bc2-e0be-4429-9a96-cb40dbf890cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.280366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5298bc2-e0be-4429-9a96-cb40dbf890cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.282162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5298bc2-e0be-4429-9a96-cb40dbf890cd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.282615 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5298bc2-e0be-4429-9a96-cb40dbf890cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.283793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-e5298bc2-e0be-4429-9a96-cb40dbf890cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:49.283793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:14:49.283793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:14:49.284962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5298bc2-e0be-4429-9a96-cb40dbf890cd admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.288586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 259/504] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:49.289639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74044b-c349-40cd-a2c0-cd44bfb73b26 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.300739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74044b-c349-40cd-a2c0-cd44bfb73b26 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.305675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9f6b7-eca9-4524-8648-a3818484b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.306690 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9f6b7-eca9-4524-8648-a3818484b39e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.307170 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9f6b7-eca9-4524-8648-a3818484b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.307697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9f6b7-eca9-4524-8648-a3818484b39e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.309054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 246/505] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.310008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5298bc2-e0be-4429-9a96-cb40dbf890cd admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.320898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9f6b7-eca9-4524-8648-a3818484b39e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.321914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5298bc2-e0be-4429-9a96-cb40dbf890cd admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.322834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9f6b7-eca9-4524-8648-a3818484b39e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.332201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c9c64-b606-4d3a-8a4d-35a76f7ed14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.332997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c9c64-b606-4d3a-8a4d-35a76f7ed14a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.333276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c9c64-b606-4d3a-8a4d-35a76f7ed14a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.333561 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c9c64-b606-4d3a-8a4d-35a76f7ed14a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.341213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e1d9f6b7-eca9-4524-8648-a3818484b39e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:49.348084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 260/506] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:49.348084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9f6b7-eca9-4524-8648-a3818484b39e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.351899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c9c64-b606-4d3a-8a4d-35a76f7ed14a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.354701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c9c64-b606-4d3a-8a4d-35a76f7ed14a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.357894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9f6b7-eca9-4524-8648-a3818484b39e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.362994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16a71c-00b6-46ce-a9c8-e713e1163949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.363713 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16a71c-00b6-46ce-a9c8-e713e1163949 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.364076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16a71c-00b6-46ce-a9c8-e713e1163949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.364415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16a71c-00b6-46ce-a9c8-e713e1163949 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.365311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16a71c-00b6-46ce-a9c8-e713e1163949 admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=9801d0694ec54d65bdd5b8914e05637e) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.365676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16a71c-00b6-46ce-a9c8-e713e1163949 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.367497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16a71c-00b6-46ce-a9c8-e713e1163949 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.373019 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 261/507] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/role_assignments?user.id=9801d0694ec54d65bdd5b8914e05637e&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.380364 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfb58d-2cf2-4d0d-b53e-ebab1e0a7e38 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.380364 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfb58d-2cf2-4d0d-b53e-ebab1e0a7e38 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.380364 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfb58d-2cf2-4d0d-b53e-ebab1e0a7e38 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.380364 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 262/508] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:49.380364 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfb58d-2cf2-4d0d-b53e-ebab1e0a7e38 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.380684 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-fb4c9c64-b606-4d3a-8a4d-35a76f7ed14a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:49.380684 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 247/509] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:49.387623 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845675d8-166d-4630-8784-5e2faef642e4 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.388367 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845675d8-166d-4630-8784-5e2faef642e4 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.388814 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845675d8-166d-4630-8784-5e2faef642e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.397814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfb58d-2cf2-4d0d-b53e-ebab1e0a7e38 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.403358 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45c999-da15-40ad-90fe-648889f4ba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.404244 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45c999-da15-40ad-90fe-648889f4ba87 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.404586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45c999-da15-40ad-90fe-648889f4ba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.404971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45c999-da15-40ad-90fe-648889f4ba87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.406397 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45c999-da15-40ad-90fe-648889f4ba87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.406869 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45c999-da15-40ad-90fe-648889f4ba87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.408745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45c999-da15-40ad-90fe-648889f4ba87 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.427264 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 263/510] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.427264 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45c999-da15-40ad-90fe-648889f4ba87 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.441744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45c999-da15-40ad-90fe-648889f4ba87 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.447099 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9664f-4a53-4c26-98bf-1b8bb819b985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.448070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9664f-4a53-4c26-98bf-1b8bb819b985 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.448536 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9664f-4a53-4c26-98bf-1b8bb819b985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.448949 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9664f-4a53-4c26-98bf-1b8bb819b985 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.449843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9664f-4a53-4c26-98bf-1b8bb819b985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.450294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9664f-4a53-4c26-98bf-1b8bb819b985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.452119 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9664f-4a53-4c26-98bf-1b8bb819b985 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.472649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 264/511] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.473897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9664f-4a53-4c26-98bf-1b8bb819b985 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.485542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9664f-4a53-4c26-98bf-1b8bb819b985 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.490676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf89b0-a46d-4a71-8827-fc6c5f7d172b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.491745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf89b0-a46d-4a71-8827-fc6c5f7d172b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.492238 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf89b0-a46d-4a71-8827-fc6c5f7d172b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.492654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf89b0-a46d-4a71-8827-fc6c5f7d172b admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.504548 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf89b0-a46d-4a71-8827-fc6c5f7d172b admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.506898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf89b0-a46d-4a71-8827-fc6c5f7d172b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.523361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-ddaf89b0-a46d-4a71-8827-fc6c5f7d172b admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 09:14:49.529872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 265/512] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:49.531852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf89b0-a46d-4a71-8827-fc6c5f7d172b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.542165 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf89b0-a46d-4a71-8827-fc6c5f7d172b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.548540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6c933-8a5b-4eb3-9fad-6910a42d0544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.549856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6c933-8a5b-4eb3-9fad-6910a42d0544 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.550292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6c933-8a5b-4eb3-9fad-6910a42d0544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.550701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6c933-8a5b-4eb3-9fad-6910a42d0544 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.553445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-845675d8-166d-4630-8784-5e2faef642e4 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:49.554812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-845675d8-166d-4630-8784-5e2faef642e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:49.560009 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6c933-8a5b-4eb3-9fad-6910a42d0544 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.562604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6c933-8a5b-4eb3-9fad-6910a42d0544 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.569806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 248/513] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:49.569806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845675d8-166d-4630-8784-5e2faef642e4 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.575390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845675d8-166d-4630-8784-5e2faef642e4 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.580480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc74647-d73f-461f-931c-384a13659162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.581207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc74647-d73f-461f-931c-384a13659162 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.581578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc74647-d73f-461f-931c-384a13659162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.581943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc74647-d73f-461f-931c-384a13659162 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.582881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc74647-d73f-461f-931c-384a13659162 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.583282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc74647-d73f-461f-931c-384a13659162 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.585281 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc74647-d73f-461f-931c-384a13659162 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.590888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-7da6c933-8a5b-4eb3-9fad-6910a42d0544 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:49.593885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 266/514] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:49.599560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6c933-8a5b-4eb3-9fad-6910a42d0544 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.610116 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 249/515] 10.222.0.90 () {56 vars in 1158 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.610325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc74647-d73f-461f-931c-384a13659162 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.612235 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6c933-8a5b-4eb3-9fad-6910a42d0544 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.617520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178236e7-674d-47ba-840c-8b51bc748b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.618200 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178236e7-674d-47ba-840c-8b51bc748b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.618464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178236e7-674d-47ba-840c-8b51bc748b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.618752 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178236e7-674d-47ba-840c-8b51bc748b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.619526 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178236e7-674d-47ba-840c-8b51bc748b44 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.619830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178236e7-674d-47ba-840c-8b51bc748b44 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.620586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc74647-d73f-461f-931c-384a13659162 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.620920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-178236e7-674d-47ba-840c-8b51bc748b44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:49.620920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:14:49.620920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:14:49.622200 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178236e7-674d-47ba-840c-8b51bc748b44 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.626786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dc5e9-4095-4f4b-8232-970e54cee8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.627830 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dc5e9-4095-4f4b-8232-970e54cee8df admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.628325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dc5e9-4095-4f4b-8232-970e54cee8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.628727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dc5e9-4095-4f4b-8232-970e54cee8df admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.643558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dc5e9-4095-4f4b-8232-970e54cee8df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:49.648226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 267/516] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:49.649170 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178236e7-674d-47ba-840c-8b51bc748b44 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.651514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-3f9dc5e9-4095-4f4b-8232-970e54cee8df admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:49.652926 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 250/517] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:49.653903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dc5e9-4095-4f4b-8232-970e54cee8df admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.666057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178236e7-674d-47ba-840c-8b51bc748b44 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.667890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dc5e9-4095-4f4b-8232-970e54cee8df admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.671033 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9a43-0f46-4791-8cd5-d2ec62771f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.672125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9a43-0f46-4791-8cd5-d2ec62771f03 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.672666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9a43-0f46-4791-8cd5-d2ec62771f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.673328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb65146-9dad-446f-8b29-c3c1112e5889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.673698 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca9a43-0f46-4791-8cd5-d2ec62771f03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.673962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb65146-9dad-446f-8b29-c3c1112e5889 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.674295 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb65146-9dad-446f-8b29-c3c1112e5889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.674569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb65146-9dad-446f-8b29-c3c1112e5889 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.675567 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb65146-9dad-446f-8b29-c3c1112e5889 admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=5074090dca0b4a49b54dc252a5dd9420) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.675875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb65146-9dad-446f-8b29-c3c1112e5889 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.677987 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb65146-9dad-446f-8b29-c3c1112e5889 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.683578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca9a43-0f46-4791-8cd5-d2ec62771f03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.685335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 251/518] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/role_assignments?user.id=5074090dca0b4a49b54dc252a5dd9420&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.686149 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca9a43-0f46-4791-8cd5-d2ec62771f03 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.686255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb65146-9dad-446f-8b29-c3c1112e5889 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.697478 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 268/519] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:49.697917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb65146-9dad-446f-8b29-c3c1112e5889 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.705160 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9a43-0f46-4791-8cd5-d2ec62771f03 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.709037 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5ce28-5a44-4d8f-9f17-dbdfacf947e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.710586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5ce28-5a44-4d8f-9f17-dbdfacf947e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.711386 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5ce28-5a44-4d8f-9f17-dbdfacf947e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.712248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5ce28-5a44-4d8f-9f17-dbdfacf947e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.714008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5ce28-5a44-4d8f-9f17-dbdfacf947e4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.714635 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca9a43-0f46-4791-8cd5-d2ec62771f03 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.715246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5ce28-5a44-4d8f-9f17-dbdfacf947e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.719558 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4658a3-a382-45a9-9fd1-dbe6f8ccce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.720326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5ce28-5a44-4d8f-9f17-dbdfacf947e4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.720478 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4658a3-a382-45a9-9fd1-dbe6f8ccce2d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.720728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4658a3-a382-45a9-9fd1-dbe6f8ccce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.721017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4658a3-a382-45a9-9fd1-dbe6f8ccce2d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.732871 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4658a3-a382-45a9-9fd1-dbe6f8ccce2d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.735781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4658a3-a382-45a9-9fd1-dbe6f8ccce2d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.739662 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 252/520] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.751060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5ce28-5a44-4d8f-9f17-dbdfacf947e4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.760198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-7e4658a3-a382-45a9-9fd1-dbe6f8ccce2d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:49.762699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 269/521] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:49.772095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4658a3-a382-45a9-9fd1-dbe6f8ccce2d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.779888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4658a3-a382-45a9-9fd1-dbe6f8ccce2d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.784280 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5ce28-5a44-4d8f-9f17-dbdfacf947e4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.785422 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddc09e-9800-491a-9ed9-1f59f4b84516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.786092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddc09e-9800-491a-9ed9-1f59f4b84516 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.786376 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddc09e-9800-491a-9ed9-1f59f4b84516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.786673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddc09e-9800-491a-9ed9-1f59f4b84516 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.787387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddc09e-9800-491a-9ed9-1f59f4b84516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.792085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddc09e-9800-491a-9ed9-1f59f4b84516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.792085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddc09e-9800-491a-9ed9-1f59f4b84516 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.803542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 270/522] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.805467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3b213-a40e-4620-83e8-7845fa7fba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.807216 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3b213-a40e-4620-83e8-7845fa7fba46 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.808180 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3b213-a40e-4620-83e8-7845fa7fba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.808942 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3b213-a40e-4620-83e8-7845fa7fba46 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.809124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddc09e-9800-491a-9ed9-1f59f4b84516 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.832311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddc09e-9800-491a-9ed9-1f59f4b84516 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.836669 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3b213-a40e-4620-83e8-7845fa7fba46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.838726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3b213-a40e-4620-83e8-7845fa7fba46 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.853464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af345e36-bb19-438b-aac7-02d0b05795ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.854262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345e36-bb19-438b-aac7-02d0b05795ef admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.854542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345e36-bb19-438b-aac7-02d0b05795ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.854815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345e36-bb19-438b-aac7-02d0b05795ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.858109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-c1f3b213-a40e-4620-83e8-7845fa7fba46 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:49.860527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 253/523] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:49.866373 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3b213-a40e-4620-83e8-7845fa7fba46 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.877250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af345e36-bb19-438b-aac7-02d0b05795ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.878408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3b213-a40e-4620-83e8-7845fa7fba46 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.879252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af345e36-bb19-438b-aac7-02d0b05795ef admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.883394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bec615-7d79-402a-8484-4c8121147386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.884153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bec615-7d79-402a-8484-4c8121147386 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.884487 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bec615-7d79-402a-8484-4c8121147386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.884742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bec615-7d79-402a-8484-4c8121147386 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.885493 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bec615-7d79-402a-8484-4c8121147386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.886044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bec615-7d79-402a-8484-4c8121147386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.887743 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bec615-7d79-402a-8484-4c8121147386 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.903218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 254/524] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:49.909914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bec615-7d79-402a-8484-4c8121147386 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.912454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-af345e36-bb19-438b-aac7-02d0b05795ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:49.913688 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 271/525] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:49.920674 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bec615-7d79-402a-8484-4c8121147386 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.929083 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af345e36-bb19-438b-aac7-02d0b05795ef admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.930975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3177b-0579-4d99-ae70-1964f650bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.931839 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3177b-0579-4d99-ae70-1964f650bf0e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.932151 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3177b-0579-4d99-ae70-1964f650bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.932423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3177b-0579-4d99-ae70-1964f650bf0e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.941487 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3177b-0579-4d99-ae70-1964f650bf0e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.943627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3177b-0579-4d99-ae70-1964f650bf0e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.949435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af345e36-bb19-438b-aac7-02d0b05795ef admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.956737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa05c3a-10f8-4261-a93c-80cec691e3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.957383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa05c3a-10f8-4261-a93c-80cec691e3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.957665 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa05c3a-10f8-4261-a93c-80cec691e3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.957997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa05c3a-10f8-4261-a93c-80cec691e3d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.958775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa05c3a-10f8-4261-a93c-80cec691e3d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.959134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa05c3a-10f8-4261-a93c-80cec691e3d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.959467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-fbe3177b-0579-4d99-ae70-1964f650bf0e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 16 09:14:49.960680 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 255/526] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:49.962067 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa05c3a-10f8-4261-a93c-80cec691e3d8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.967030 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3177b-0579-4d99-ae70-1964f650bf0e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.977306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 272/527] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:49.977612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3177b-0579-4d99-ae70-1964f650bf0e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.982042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319314f9-6806-4d0b-9669-010c08cc499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:49.982693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319314f9-6806-4d0b-9669-010c08cc499d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:49.982957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319314f9-6806-4d0b-9669-010c08cc499d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:49.983185 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa05c3a-10f8-4261-a93c-80cec691e3d8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:49.983410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319314f9-6806-4d0b-9669-010c08cc499d admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:49.984336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319314f9-6806-4d0b-9669-010c08cc499d admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:49.984643 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319314f9-6806-4d0b-9669-010c08cc499d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:49.986503 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319314f9-6806-4d0b-9669-010c08cc499d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:49.993258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa05c3a-10f8-4261-a93c-80cec691e3d8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:49.999133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b8f83-590c-46c7-b68a-be44c13fdbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:50.000392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b8f83-590c-46c7-b68a-be44c13fdbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:50.000672 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b8f83-590c-46c7-b68a-be44c13fdbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:50.000953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b8f83-590c-46c7-b68a-be44c13fdbd6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:50.002501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b8f83-590c-46c7-b68a-be44c13fdbd6 admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=96e6c68eee11421bbb6b4066a856f228) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:50.002820 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b8f83-590c-46c7-b68a-be44c13fdbd6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:50.005152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b8f83-590c-46c7-b68a-be44c13fdbd6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:50.005676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 256/528] 10.222.0.90 () {56 vars in 1160 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:50.014584 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 273/529] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:49 2022] GET /identity/v3/role_assignments?user.id=96e6c68eee11421bbb6b4066a856f228&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:50.016126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319314f9-6806-4d0b-9669-010c08cc499d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:50.025969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319314f9-6806-4d0b-9669-010c08cc499d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:50.045801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debcc60-e602-4822-8dff-e95e5cc01a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:50.052080 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debcc60-e602-4822-8dff-e95e5cc01a68 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:50.052080 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debcc60-e602-4822-8dff-e95e5cc01a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:50.052080 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debcc60-e602-4822-8dff-e95e5cc01a68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:50.078552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debcc60-e602-4822-8dff-e95e5cc01a68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:50.081981 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debcc60-e602-4822-8dff-e95e5cc01a68 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:50.106204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 257/530] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:50.117213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b8f83-590c-46c7-b68a-be44c13fdbd6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:50.136629 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b8f83-590c-46c7-b68a-be44c13fdbd6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:50.153920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34983c35-72ec-4979-8743-73bcb49b6439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:50.154733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34983c35-72ec-4979-8743-73bcb49b6439 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:50.155012 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34983c35-72ec-4979-8743-73bcb49b6439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:50.155272 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34983c35-72ec-4979-8743-73bcb49b6439 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:50.178601 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34983c35-72ec-4979-8743-73bcb49b6439 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:50.180545 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34983c35-72ec-4979-8743-73bcb49b6439 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:50.203770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-34983c35-72ec-4979-8743-73bcb49b6439 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:50.205434 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 274/531] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:50.211587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debcc60-e602-4822-8dff-e95e5cc01a68 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:50.231241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debcc60-e602-4822-8dff-e95e5cc01a68 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:50.237983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4be0f-dd33-4872-8fa3-c736f7044238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:50.238645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4be0f-dd33-4872-8fa3-c736f7044238 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:50.238928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4be0f-dd33-4872-8fa3-c736f7044238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:50.239206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4be0f-dd33-4872-8fa3-c736f7044238 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:50.239924 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4be0f-dd33-4872-8fa3-c736f7044238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:50.240262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4be0f-dd33-4872-8fa3-c736f7044238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:50.241854 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4be0f-dd33-4872-8fa3-c736f7044238 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:50.255722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 258/532] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:50.261167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34983c35-72ec-4979-8743-73bcb49b6439 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:50.273133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34983c35-72ec-4979-8743-73bcb49b6439 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:50.279617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8d91-721b-4ff4-911f-6ed596df8d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:50.281049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8d91-721b-4ff4-911f-6ed596df8d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:50.281460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8d91-721b-4ff4-911f-6ed596df8d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:50.281735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8d91-721b-4ff4-911f-6ed596df8d18 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:50.290555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f8d91-721b-4ff4-911f-6ed596df8d18 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:50.292675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f8d91-721b-4ff4-911f-6ed596df8d18 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:50.302610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f1502-ab04-4a62-899a-d569d942f340 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:50.303081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f1502-ab04-4a62-899a-d569d942f340 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:50.303549 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f1502-ab04-4a62-899a-d569d942f340 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:50.307472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-157f8d91-721b-4ff4-911f-6ed596df8d18 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:50.308908 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 275/534] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:50.309013 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 259/534] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:50.314954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8d91-721b-4ff4-911f-6ed596df8d18 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:50.316774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da383dd-8d5e-46b6-9714-41693e68a6e2 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:50.317253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da383dd-8d5e-46b6-9714-41693e68a6e2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:50.317734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da383dd-8d5e-46b6-9714-41693e68a6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:50.325325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8d91-721b-4ff4-911f-6ed596df8d18 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:50.331205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ee3e1-a038-4a98-a3f5-33035eac2692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:50.331833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ee3e1-a038-4a98-a3f5-33035eac2692 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:50.332147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ee3e1-a038-4a98-a3f5-33035eac2692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:50.332427 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ee3e1-a038-4a98-a3f5-33035eac2692 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:50.333255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ee3e1-a038-4a98-a3f5-33035eac2692 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:50.333563 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ee3e1-a038-4a98-a3f5-33035eac2692 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:50.335553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ee3e1-a038-4a98-a3f5-33035eac2692 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:50.348372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 276/535] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:50.349547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0da383dd-8d5e-46b6-9714-41693e68a6e2 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:50.351553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0da383dd-8d5e-46b6-9714-41693e68a6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:50.354304 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ee3e1-a038-4a98-a3f5-33035eac2692 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:50.365218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ee3e1-a038-4a98-a3f5-33035eac2692 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:50.366470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 260/536] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:50.369989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764a4dd-2125-4763-8eaf-7686aa44f8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:50.370616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764a4dd-2125-4763-8eaf-7686aa44f8da admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:50.370895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764a4dd-2125-4763-8eaf-7686aa44f8da admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:50.371168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764a4dd-2125-4763-8eaf-7686aa44f8da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:50.371987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764a4dd-2125-4763-8eaf-7686aa44f8da admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=39d5d18c09054343b4e000950ba875fc) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:50.372323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764a4dd-2125-4763-8eaf-7686aa44f8da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:50.374716 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764a4dd-2125-4763-8eaf-7686aa44f8da admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:50.380987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 277/537] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:50 2022] GET /identity/v3/role_assignments?user.id=39d5d18c09054343b4e000950ba875fc&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:50.411688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da383dd-8d5e-46b6-9714-41693e68a6e2 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:50.428697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da383dd-8d5e-46b6-9714-41693e68a6e2 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:50.437900 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d26c97-7c56-4183-b0a0-99b81f726e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:50.439276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d26c97-7c56-4183-b0a0-99b81f726e45 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:50.439767 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d26c97-7c56-4183-b0a0-99b81f726e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:50.440282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d26c97-7c56-4183-b0a0-99b81f726e45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:50.460612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d26c97-7c56-4183-b0a0-99b81f726e45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:50.463886 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d26c97-7c56-4183-b0a0-99b81f726e45 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:50.512574 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-d7d26c97-7c56-4183-b0a0-99b81f726e45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:50.516473 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 261/538] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:50.525878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764a4dd-2125-4763-8eaf-7686aa44f8da admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:50.554540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764a4dd-2125-4763-8eaf-7686aa44f8da admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:50.572174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf626732-1ffb-41f4-b1b2-f34fa854c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:50.573262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf626732-1ffb-41f4-b1b2-f34fa854c278 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:50.573733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf626732-1ffb-41f4-b1b2-f34fa854c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:50.574206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf626732-1ffb-41f4-b1b2-f34fa854c278 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:50.575561 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf626732-1ffb-41f4-b1b2-f34fa854c278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:50.576189 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf626732-1ffb-41f4-b1b2-f34fa854c278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:50.579785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf626732-1ffb-41f4-b1b2-f34fa854c278 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:50.610759 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 278/539] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:50.619490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d26c97-7c56-4183-b0a0-99b81f726e45 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:50.643440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d26c97-7c56-4183-b0a0-99b81f726e45 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:50.652125 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d5624-a4aa-49ec-9e75-98ff52f9efae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:50.653194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d5624-a4aa-49ec-9e75-98ff52f9efae admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:50.653652 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d5624-a4aa-49ec-9e75-98ff52f9efae admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:50.654121 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d5624-a4aa-49ec-9e75-98ff52f9efae admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:50.655312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d5624-a4aa-49ec-9e75-98ff52f9efae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:50.666541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d5624-a4aa-49ec-9e75-98ff52f9efae admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:50.722851 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 262/540] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:14:50 2022] POST /identity/v3/users => generated 247 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:14:52.516946 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79250-6dd5-4c10-96cc-e3448018d194 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:52.517680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79250-6dd5-4c10-96cc-e3448018d194 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:52.517680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b79250-6dd5-4c10-96cc-e3448018d194 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:52.519856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 279/541] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:52.525119 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc5ec9-589a-451d-8cf8-604d672597cb None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:52.525684 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc5ec9-589a-451d-8cf8-604d672597cb None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:52.525684 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc5ec9-589a-451d-8cf8-604d672597cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:52.550891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-6ccc5ec9-589a-451d-8cf8-604d672597cb None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:52.552096 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6ccc5ec9-589a-451d-8cf8-604d672597cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:52.559667 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 263/542] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:52.595219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b79250-6dd5-4c10-96cc-e3448018d194 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:52.617729 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b79250-6dd5-4c10-96cc-e3448018d194 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:52.622129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ccd2-b299-4715-8154-0785aca62251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:52.622903 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ccd2-b299-4715-8154-0785aca62251 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:52.623176 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ccd2-b299-4715-8154-0785aca62251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:52.623445 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ccd2-b299-4715-8154-0785aca62251 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:52.641696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87ccd2-b299-4715-8154-0785aca62251 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:52.648580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-ee87ccd2-b299-4715-8154-0785aca62251 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:52.650092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 280/543] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:52.655906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc5ec9-589a-451d-8cf8-604d672597cb None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:52.668972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc5ec9-589a-451d-8cf8-604d672597cb None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:52.676800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57b337-98a5-43f5-8846-ef7a0ff48998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:52.677467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b337-98a5-43f5-8846-ef7a0ff48998 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:52.677742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b337-98a5-43f5-8846-ef7a0ff48998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:52.678014 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57b337-98a5-43f5-8846-ef7a0ff48998 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:52.678758 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57b337-98a5-43f5-8846-ef7a0ff48998 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:52.679062 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57b337-98a5-43f5-8846-ef7a0ff48998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:52.680688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57b337-98a5-43f5-8846-ef7a0ff48998 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:52.696746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 264/544] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:52.701780 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ccd2-b299-4715-8154-0785aca62251 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:52.717013 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ccd2-b299-4715-8154-0785aca62251 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:52.724088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418b392-493d-4009-8ba3-997545bf3986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:52.724890 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418b392-493d-4009-8ba3-997545bf3986 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:52.725173 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418b392-493d-4009-8ba3-997545bf3986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:52.725445 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418b392-493d-4009-8ba3-997545bf3986 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:52.748341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418b392-493d-4009-8ba3-997545bf3986 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:52.750870 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418b392-493d-4009-8ba3-997545bf3986 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:52.775458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-4418b392-493d-4009-8ba3-997545bf3986 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:52.776900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 281/545] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:52.783088 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57b337-98a5-43f5-8846-ef7a0ff48998 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:52.797420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57b337-98a5-43f5-8846-ef7a0ff48998 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:52.807461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5275d-c7e8-4096-ba58-ee47ad72d637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:52.808139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5275d-c7e8-4096-ba58-ee47ad72d637 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:52.808417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5275d-c7e8-4096-ba58-ee47ad72d637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:52.808691 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5275d-c7e8-4096-ba58-ee47ad72d637 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:52.809408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5275d-c7e8-4096-ba58-ee47ad72d637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:52.809705 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5275d-c7e8-4096-ba58-ee47ad72d637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:52.811303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5275d-c7e8-4096-ba58-ee47ad72d637 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:52.830076 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 265/546] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:52.835402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418b392-493d-4009-8ba3-997545bf3986 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:52.849317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418b392-493d-4009-8ba3-997545bf3986 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:52.857378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb8aba-c322-4a84-b01d-c1fb3328a4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:52.858171 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb8aba-c322-4a84-b01d-c1fb3328a4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:52.858447 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb8aba-c322-4a84-b01d-c1fb3328a4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:52.859280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb8aba-c322-4a84-b01d-c1fb3328a4d5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:52.868474 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb8aba-c322-4a84-b01d-c1fb3328a4d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:52.870672 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb8aba-c322-4a84-b01d-c1fb3328a4d5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:52.890530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a0cb8aba-c322-4a84-b01d-c1fb3328a4d5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 09:14:52.891908 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 282/547] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Feb 16 09:14:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:52.897399 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5275d-c7e8-4096-ba58-ee47ad72d637 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:52.907311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5275d-c7e8-4096-ba58-ee47ad72d637 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:52.913599 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa094db0-f6a1-4b2a-832d-891a28f6530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:52.914262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa094db0-f6a1-4b2a-832d-891a28f6530f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:52.914539 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa094db0-f6a1-4b2a-832d-891a28f6530f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:52.914810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa094db0-f6a1-4b2a-832d-891a28f6530f admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:52.915813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa094db0-f6a1-4b2a-832d-891a28f6530f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:52.916142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa094db0-f6a1-4b2a-832d-891a28f6530f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:52.917971 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa094db0-f6a1-4b2a-832d-891a28f6530f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:52.943397 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 266/548] 10.222.0.90 () {56 vars in 1154 bytes} [Wed Feb 16 09:14:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:52.948775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb8aba-c322-4a84-b01d-c1fb3328a4d5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:52.959282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb8aba-c322-4a84-b01d-c1fb3328a4d5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:52.967496 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaba07-7457-4566-ae86-30c13cf416ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:52.968933 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaba07-7457-4566-ae86-30c13cf416ac admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:52.969195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaba07-7457-4566-ae86-30c13cf416ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:52.969473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaba07-7457-4566-ae86-30c13cf416ac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:52.985094 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d4153-5950-43e9-81f0-37c2cc908eb2 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:52.985402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d4153-5950-43e9-81f0-37c2cc908eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:52.985638 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d4153-5950-43e9-81f0-37c2cc908eb2 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:52.987398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 267/549] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:52.989319 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aaba07-7457-4566-ae86-30c13cf416ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:52.991248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aaba07-7457-4566-ae86-30c13cf416ac admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:52.992853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b0e7b-dd33-4a07-a22e-1cdffae4c645 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:52.993135 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b0e7b-dd33-4a07-a22e-1cdffae4c645 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:52.993408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b0e7b-dd33-4a07-a22e-1cdffae4c645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.008830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-56aaba07-7457-4566-ae86-30c13cf416ac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:53.010348 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 283/550] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.021345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0a263-7b6a-4b0a-8549-03a8cdf36df1 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.021633 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0a263-7b6a-4b0a-8549-03a8cdf36df1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.021884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0a263-7b6a-4b0a-8549-03a8cdf36df1 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.023873 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 284/551] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:53.024763 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0a263-7b6a-4b0a-8549-03a8cdf36df1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.035695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-349b0e7b-dd33-4a07-a22e-1cdffae4c645 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:53.037043 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-349b0e7b-dd33-4a07-a22e-1cdffae4c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:53.042224 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0a263-7b6a-4b0a-8549-03a8cdf36df1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.045600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 268/552] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:53.047073 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e1f16-736d-4540-9bd9-4db6ac0ccf9e None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.047354 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e1f16-736d-4540-9bd9-4db6ac0ccf9e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.047652 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e1f16-736d-4540-9bd9-4db6ac0ccf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.048529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f7739-edc6-44d2-811f-d83bf9211239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.049782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f7739-edc6-44d2-811f-d83bf9211239 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.050278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f7739-edc6-44d2-811f-d83bf9211239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.050890 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f7739-edc6-44d2-811f-d83bf9211239 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.051967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f7739-edc6-44d2-811f-d83bf9211239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.052547 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f7739-edc6-44d2-811f-d83bf9211239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.055690 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f7739-edc6-44d2-811f-d83bf9211239 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.066630 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-ad9e1f16-736d-4540-9bd9-4db6ac0ccf9e None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:53.068527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ad9e1f16-736d-4540-9bd9-4db6ac0ccf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:53.070832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 285/553] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.076175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f7739-edc6-44d2-811f-d83bf9211239 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.076456 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 269/554] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:53.084048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e1f16-736d-4540-9bd9-4db6ac0ccf9e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.099516 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f7739-edc6-44d2-811f-d83bf9211239 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.102069 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e1f16-736d-4540-9bd9-4db6ac0ccf9e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.109627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd9e15-6759-4c27-ae1e-b3e906e40462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.110411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd9e15-6759-4c27-ae1e-b3e906e40462 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.110687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd9e15-6759-4c27-ae1e-b3e906e40462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.110954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd9e15-6759-4c27-ae1e-b3e906e40462 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.111941 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55789154-8561-46a8-911a-c51dd67dce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.112797 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55789154-8561-46a8-911a-c51dd67dce5a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.113069 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55789154-8561-46a8-911a-c51dd67dce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.113333 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55789154-8561-46a8-911a-c51dd67dce5a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.121825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55789154-8561-46a8-911a-c51dd67dce5a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.123668 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55789154-8561-46a8-911a-c51dd67dce5a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.126827 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd9e15-6759-4c27-ae1e-b3e906e40462 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:53.134158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-03dd9e15-6759-4c27-ae1e-b3e906e40462 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:53.135843 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 270/555] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.136908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd9e15-6759-4c27-ae1e-b3e906e40462 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.137469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-55789154-8561-46a8-911a-c51dd67dce5a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:53.138889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 286/556] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.141922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55789154-8561-46a8-911a-c51dd67dce5a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.148806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd9e15-6759-4c27-ae1e-b3e906e40462 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.153513 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d9906-ffb6-4e02-8672-cce744c2508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.153663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55789154-8561-46a8-911a-c51dd67dce5a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.154889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d9906-ffb6-4e02-8672-cce744c2508a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.156159 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d9906-ffb6-4e02-8672-cce744c2508a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.156784 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d9906-ffb6-4e02-8672-cce744c2508a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.158843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1a6a4-10ec-4524-9cdd-007939c7519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.159579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1a6a4-10ec-4524-9cdd-007939c7519a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.159856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1a6a4-10ec-4524-9cdd-007939c7519a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.160152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1a6a4-10ec-4524-9cdd-007939c7519a admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.160986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1a6a4-10ec-4524-9cdd-007939c7519a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.161218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1a6a4-10ec-4524-9cdd-007939c7519a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.162936 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1a6a4-10ec-4524-9cdd-007939c7519a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.170004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d9906-ffb6-4e02-8672-cce744c2508a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:53.172256 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 287/557] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:53.173297 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1a6a4-10ec-4524-9cdd-007939c7519a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.178716 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-698d9906-ffb6-4e02-8672-cce744c2508a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:53.180182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 271/558] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.181133 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d9906-ffb6-4e02-8672-cce744c2508a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.185908 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1a6a4-10ec-4524-9cdd-007939c7519a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.191288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad43411-9fbb-4c24-859b-1aab5ba8cff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.191970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad43411-9fbb-4c24-859b-1aab5ba8cff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.192279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad43411-9fbb-4c24-859b-1aab5ba8cff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.192548 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad43411-9fbb-4c24-859b-1aab5ba8cff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.193512 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad43411-9fbb-4c24-859b-1aab5ba8cff4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.193819 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad43411-9fbb-4c24-859b-1aab5ba8cff4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.194034 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d9906-ffb6-4e02-8672-cce744c2508a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.195980 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad43411-9fbb-4c24-859b-1aab5ba8cff4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.198982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056dfc3-6c94-4de1-a599-d4cc7346982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.199958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056dfc3-6c94-4de1-a599-d4cc7346982b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.200460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056dfc3-6c94-4de1-a599-d4cc7346982b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.200928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056dfc3-6c94-4de1-a599-d4cc7346982b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.209927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 288/559] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.210902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad43411-9fbb-4c24-859b-1aab5ba8cff4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.213665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056dfc3-6c94-4de1-a599-d4cc7346982b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.215845 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056dfc3-6c94-4de1-a599-d4cc7346982b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.221825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad43411-9fbb-4c24-859b-1aab5ba8cff4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.227095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9318fcf-671f-461c-a89a-3cfd7da684b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.227804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9318fcf-671f-461c-a89a-3cfd7da684b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.228117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9318fcf-671f-461c-a89a-3cfd7da684b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.228440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9318fcf-671f-461c-a89a-3cfd7da684b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.229175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9318fcf-671f-461c-a89a-3cfd7da684b0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.229475 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9318fcf-671f-461c-a89a-3cfd7da684b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.231186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9318fcf-671f-461c-a89a-3cfd7da684b0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.236371 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-e056dfc3-6c94-4de1-a599-d4cc7346982b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:53.237836 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 272/560] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.238777 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056dfc3-6c94-4de1-a599-d4cc7346982b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.240829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 289/561] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.246015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9318fcf-671f-461c-a89a-3cfd7da684b0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.250594 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056dfc3-6c94-4de1-a599-d4cc7346982b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.255475 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acdefd-dfd9-40e1-aa11-5b3478734e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.256248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9318fcf-671f-461c-a89a-3cfd7da684b0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.256989 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acdefd-dfd9-40e1-aa11-5b3478734e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.257549 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acdefd-dfd9-40e1-aa11-5b3478734e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.258215 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acdefd-dfd9-40e1-aa11-5b3478734e59 admin admin] PATH_INFO: `/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/9801d0694ec54d65bdd5b8914e05637e/roles/068cd8712b8547b89967dd5d7964007b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.260859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02534592-ac49-4e3c-8348-b143e63ee934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.261492 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02534592-ac49-4e3c-8348-b143e63ee934 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.261767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02534592-ac49-4e3c-8348-b143e63ee934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.262212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02534592-ac49-4e3c-8348-b143e63ee934 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.262934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02534592-ac49-4e3c-8348-b143e63ee934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.263235 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02534592-ac49-4e3c-8348-b143e63ee934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.265673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02534592-ac49-4e3c-8348-b143e63ee934 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.276938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acdefd-dfd9-40e1-aa11-5b3478734e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ab51e6e2745658b252fbafdc2f8ef, user_id=9801d0694ec54d65bdd5b8914e05637e, role_id=068cd8712b8547b89967dd5d7964007b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.277874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 290/562] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.278893 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02534592-ac49-4e3c-8348-b143e63ee934 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.280087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acdefd-dfd9-40e1-aa11-5b3478734e59 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.288471 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02534592-ac49-4e3c-8348-b143e63ee934 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.294266 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 273/563] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:53 2022] PUT /identity/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/9801d0694ec54d65bdd5b8914e05637e/roles/068cd8712b8547b89967dd5d7964007b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:53.295719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ba0b6-515a-49fd-91b4-91f497ac7d2e None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.296200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ba0b6-515a-49fd-91b4-91f497ac7d2e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.296851 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ba0b6-515a-49fd-91b4-91f497ac7d2e None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.298889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 274/564] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:53.299552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ba0b6-515a-49fd-91b4-91f497ac7d2e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.358007 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f182c-1dad-46c8-acf9-467bad3fa132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.359135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f182c-1dad-46c8-acf9-467bad3fa132 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.359418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f182c-1dad-46c8-acf9-467bad3fa132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.359691 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f182c-1dad-46c8-acf9-467bad3fa132 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.371221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f182c-1dad-46c8-acf9-467bad3fa132 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.373142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f182c-1dad-46c8-acf9-467bad3fa132 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.388562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ba0b6-515a-49fd-91b4-91f497ac7d2e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.392771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-934f182c-1dad-46c8-acf9-467bad3fa132 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:53.394083 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 291/565] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.395615 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c30cf2-a74d-4c5d-b9eb-3bbdeef05b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.397240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c30cf2-a74d-4c5d-b9eb-3bbdeef05b30 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.397918 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c30cf2-a74d-4c5d-b9eb-3bbdeef05b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.398580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c30cf2-a74d-4c5d-b9eb-3bbdeef05b30 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.400063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c703c-1bdf-434e-b225-9fe69b07a6ff None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.400356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c703c-1bdf-434e-b225-9fe69b07a6ff None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.400677 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c703c-1bdf-434e-b225-9fe69b07a6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.409744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c30cf2-a74d-4c5d-b9eb-3bbdeef05b30 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.412285 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c30cf2-a74d-4c5d-b9eb-3bbdeef05b30 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.422139 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-237c703c-1bdf-434e-b225-9fe69b07a6ff None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:53.423358 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-237c703c-1bdf-434e-b225-9fe69b07a6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:53.432725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-e4c30cf2-a74d-4c5d-b9eb-3bbdeef05b30 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 09:14:53.434704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 275/566] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.434897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 292/567] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:53.435875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c703c-1bdf-434e-b225-9fe69b07a6ff None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.440420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c30cf2-a74d-4c5d-b9eb-3bbdeef05b30 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.445931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c703c-1bdf-434e-b225-9fe69b07a6ff None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.450314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72ea27-e314-4fc1-8e02-dbf0b39cd5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.450948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72ea27-e314-4fc1-8e02-dbf0b39cd5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.451227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72ea27-e314-4fc1-8e02-dbf0b39cd5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.451564 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72ea27-e314-4fc1-8e02-dbf0b39cd5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.452282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72ea27-e314-4fc1-8e02-dbf0b39cd5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.453107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72ea27-e314-4fc1-8e02-dbf0b39cd5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.454708 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72ea27-e314-4fc1-8e02-dbf0b39cd5d1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.455360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c30cf2-a74d-4c5d-b9eb-3bbdeef05b30 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.460933 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab561c-a30f-4035-bc7d-a084423c04d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.462471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab561c-a30f-4035-bc7d-a084423c04d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.462965 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab561c-a30f-4035-bc7d-a084423c04d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.463442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab561c-a30f-4035-bc7d-a084423c04d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.465361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab561c-a30f-4035-bc7d-a084423c04d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.465896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab561c-a30f-4035-bc7d-a084423c04d2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.468241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab561c-a30f-4035-bc7d-a084423c04d2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.472093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 293/568] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.473450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72ea27-e314-4fc1-8e02-dbf0b39cd5d1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.484817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72ea27-e314-4fc1-8e02-dbf0b39cd5d1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.489588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6475d1-b30d-4d97-ba17-fa450a42c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.490488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6475d1-b30d-4d97-ba17-fa450a42c083 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.490768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6475d1-b30d-4d97-ba17-fa450a42c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.491041 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6475d1-b30d-4d97-ba17-fa450a42c083 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.493280 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 276/569] 10.222.0.90 () {56 vars in 1158 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.494377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab561c-a30f-4035-bc7d-a084423c04d2 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.501019 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6475d1-b30d-4d97-ba17-fa450a42c083 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.503216 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6475d1-b30d-4d97-ba17-fa450a42c083 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.505955 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab561c-a30f-4035-bc7d-a084423c04d2 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.510917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a3546-5d57-4ac9-911a-90b4a7001c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.512058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a3546-5d57-4ac9-911a-90b4a7001c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.512547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a3546-5d57-4ac9-911a-90b4a7001c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.513021 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a3546-5d57-4ac9-911a-90b4a7001c3a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.518553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-2d6475d1-b30d-4d97-ba17-fa450a42c083 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 16 09:14:53.524108 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 294/570] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.526745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6475d1-b30d-4d97-ba17-fa450a42c083 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.531797 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a3546-5d57-4ac9-911a-90b4a7001c3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:53.538136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6475d1-b30d-4d97-ba17-fa450a42c083 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.539806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-588a3546-5d57-4ac9-911a-90b4a7001c3a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:53.541839 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 277/571] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.542930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a3546-5d57-4ac9-911a-90b4a7001c3a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.543037 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649ace2-421b-49b0-89aa-c49c0818950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.543778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649ace2-421b-49b0-89aa-c49c0818950d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.544161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649ace2-421b-49b0-89aa-c49c0818950d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.544433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649ace2-421b-49b0-89aa-c49c0818950d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.554596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a3546-5d57-4ac9-911a-90b4a7001c3a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.558018 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649ace2-421b-49b0-89aa-c49c0818950d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.559617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec68951-7072-4e2e-9956-b671d64cb596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.559817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649ace2-421b-49b0-89aa-c49c0818950d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.560504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec68951-7072-4e2e-9956-b671d64cb596 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.560900 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec68951-7072-4e2e-9956-b671d64cb596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.561275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec68951-7072-4e2e-9956-b671d64cb596 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.562795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec68951-7072-4e2e-9956-b671d64cb596 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.563213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec68951-7072-4e2e-9956-b671d64cb596 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.565192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec68951-7072-4e2e-9956-b671d64cb596 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.578387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-0649ace2-421b-49b0-89aa-c49c0818950d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:53.579606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 295/572] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.580488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649ace2-421b-49b0-89aa-c49c0818950d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.584639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 278/573] 10.222.0.90 () {56 vars in 1158 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.585637 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec68951-7072-4e2e-9956-b671d64cb596 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.594692 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649ace2-421b-49b0-89aa-c49c0818950d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.595683 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec68951-7072-4e2e-9956-b671d64cb596 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.599356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104b1a1-900d-4dd4-9bec-e7cd25bd999c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.600246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104b1a1-900d-4dd4-9bec-e7cd25bd999c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.600542 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51613e-687a-4809-a0b6-edf7a66b7b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.600885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104b1a1-900d-4dd4-9bec-e7cd25bd999c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.601291 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104b1a1-900d-4dd4-9bec-e7cd25bd999c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.601470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51613e-687a-4809-a0b6-edf7a66b7b12 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.601851 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51613e-687a-4809-a0b6-edf7a66b7b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.602227 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51613e-687a-4809-a0b6-edf7a66b7b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.602646 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104b1a1-900d-4dd4-9bec-e7cd25bd999c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.603129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51613e-687a-4809-a0b6-edf7a66b7b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.603266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104b1a1-900d-4dd4-9bec-e7cd25bd999c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.603608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51613e-687a-4809-a0b6-edf7a66b7b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.605314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51613e-687a-4809-a0b6-edf7a66b7b12 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.605534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8104b1a1-900d-4dd4-9bec-e7cd25bd999c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.616102 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 296/574] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.617381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104b1a1-900d-4dd4-9bec-e7cd25bd999c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.618301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 279/575] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.624844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51613e-687a-4809-a0b6-edf7a66b7b12 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.630140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104b1a1-900d-4dd4-9bec-e7cd25bd999c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.632517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51613e-687a-4809-a0b6-edf7a66b7b12 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.635409 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84b519-511a-4ea4-b1d6-6758a2756984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.636506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84b519-511a-4ea4-b1d6-6758a2756984 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.637034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84b519-511a-4ea4-b1d6-6758a2756984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.637138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb5663-2b34-4645-b793-53e12774b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.637633 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84b519-511a-4ea4-b1d6-6758a2756984 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.637886 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb5663-2b34-4645-b793-53e12774b5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.638170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb5663-2b34-4645-b793-53e12774b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.638441 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb5663-2b34-4645-b793-53e12774b5a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.650286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84b519-511a-4ea4-b1d6-6758a2756984 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.650454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb5663-2b34-4645-b793-53e12774b5a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.652249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb5663-2b34-4645-b793-53e12774b5a2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.652901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84b519-511a-4ea4-b1d6-6758a2756984 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.669954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-25fb5663-2b34-4645-b793-53e12774b5a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:53.671616 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 280/576] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.672253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-5e84b519-511a-4ea4-b1d6-6758a2756984 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:53.673937 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 297/577] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.676595 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb5663-2b34-4645-b793-53e12774b5a2 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.677557 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84b519-511a-4ea4-b1d6-6758a2756984 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.687478 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb5663-2b34-4645-b793-53e12774b5a2 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.688535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84b519-511a-4ea4-b1d6-6758a2756984 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.692488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9d6d7-58da-49dc-b957-3fc61822605f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.693414 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9d6d7-58da-49dc-b957-3fc61822605f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.693694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9d6d7-58da-49dc-b957-3fc61822605f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.693966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9d6d7-58da-49dc-b957-3fc61822605f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.694470 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7759027-440b-460d-927c-2968811d8a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.695320 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7759027-440b-460d-927c-2968811d8a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.695841 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7759027-440b-460d-927c-2968811d8a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.696335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7759027-440b-460d-927c-2968811d8a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.697351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7759027-440b-460d-927c-2968811d8a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.697884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7759027-440b-460d-927c-2968811d8a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.699836 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7759027-440b-460d-927c-2968811d8a02 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.701106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9d6d7-58da-49dc-b957-3fc61822605f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.703924 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9d6d7-58da-49dc-b957-3fc61822605f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.713771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 298/578] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.714858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7759027-440b-460d-927c-2968811d8a02 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.719845 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-01a9d6d7-58da-49dc-b957-3fc61822605f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:53.723821 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 281/579] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.724572 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9d6d7-58da-49dc-b957-3fc61822605f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.731323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7759027-440b-460d-927c-2968811d8a02 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.736864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585ebb9-f781-4641-929c-037f17fee756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.737765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9d6d7-58da-49dc-b957-3fc61822605f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.738120 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585ebb9-f781-4641-929c-037f17fee756 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.738598 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585ebb9-f781-4641-929c-037f17fee756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.739106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585ebb9-f781-4641-929c-037f17fee756 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.740156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585ebb9-f781-4641-929c-037f17fee756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.740698 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585ebb9-f781-4641-929c-037f17fee756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.742123 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ccc76-39ed-4208-b4f1-4d8297060f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.742896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ccc76-39ed-4208-b4f1-4d8297060f63 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.743138 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585ebb9-f781-4641-929c-037f17fee756 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.743240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ccc76-39ed-4208-b4f1-4d8297060f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.743430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ccc76-39ed-4208-b4f1-4d8297060f63 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.751193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ccc76-39ed-4208-b4f1-4d8297060f63 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.753267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ccc76-39ed-4208-b4f1-4d8297060f63 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.759031 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 299/580] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.760543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585ebb9-f781-4641-929c-037f17fee756 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.768729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-d39ccc76-39ed-4208-b4f1-4d8297060f63 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 16 09:14:53.770194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 282/581] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.770964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ccc76-39ed-4208-b4f1-4d8297060f63 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.772560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585ebb9-f781-4641-929c-037f17fee756 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.779661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cc16d-dafd-4a13-8483-09e24faaa0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.781195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cc16d-dafd-4a13-8483-09e24faaa0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.781824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cc16d-dafd-4a13-8483-09e24faaa0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.782303 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cc16d-dafd-4a13-8483-09e24faaa0d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.783339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cc16d-dafd-4a13-8483-09e24faaa0d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.783915 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cc16d-dafd-4a13-8483-09e24faaa0d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.786071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cc16d-dafd-4a13-8483-09e24faaa0d0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.786431 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ccc76-39ed-4208-b4f1-4d8297060f63 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.790836 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19316ca8-23d4-4672-9276-38abdadb9fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.791552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19316ca8-23d4-4672-9276-38abdadb9fce admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.791830 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19316ca8-23d4-4672-9276-38abdadb9fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.792147 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19316ca8-23d4-4672-9276-38abdadb9fce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.800403 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19316ca8-23d4-4672-9276-38abdadb9fce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.802153 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 300/582] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.802421 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19316ca8-23d4-4672-9276-38abdadb9fce admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.803571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cc16d-dafd-4a13-8483-09e24faaa0d0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.815276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cc16d-dafd-4a13-8483-09e24faaa0d0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.818502 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-19316ca8-23d4-4672-9276-38abdadb9fce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:53.820089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 283/583] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:53.820945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19316ca8-23d4-4672-9276-38abdadb9fce admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.821398 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4f1d4-9fdb-4010-981e-4a50a3f2524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.822392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4f1d4-9fdb-4010-981e-4a50a3f2524d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.822887 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4f1d4-9fdb-4010-981e-4a50a3f2524d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.823408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4f1d4-9fdb-4010-981e-4a50a3f2524d admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.824499 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4f1d4-9fdb-4010-981e-4a50a3f2524d admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.825044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4f1d4-9fdb-4010-981e-4a50a3f2524d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.826368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-79f4f1d4-9fdb-4010-981e-4a50a3f2524d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:14:53.826368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:14:53.826368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:14:53.828092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4f1d4-9fdb-4010-981e-4a50a3f2524d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.833163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19316ca8-23d4-4672-9276-38abdadb9fce admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.837614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5beee-eeac-4785-8c48-897de88b411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.838494 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5beee-eeac-4785-8c48-897de88b411b admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.838770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5beee-eeac-4785-8c48-897de88b411b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.839043 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5beee-eeac-4785-8c48-897de88b411b admin admin] PATH_INFO: `/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/96e6c68eee11421bbb6b4066a856f228/roles/068cd8712b8547b89967dd5d7964007b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.854501 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5beee-eeac-4785-8c48-897de88b411b admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ab51e6e2745658b252fbafdc2f8ef, user_id=96e6c68eee11421bbb6b4066a856f228, role_id=068cd8712b8547b89967dd5d7964007b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.857177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5beee-eeac-4785-8c48-897de88b411b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.872566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 301/584] 10.222.0.90 () {56 vars in 1160 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.873712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4f1d4-9fdb-4010-981e-4a50a3f2524d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.878321 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 284/585] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:53 2022] PUT /identity/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/96e6c68eee11421bbb6b4066a856f228/roles/068cd8712b8547b89967dd5d7964007b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:53.881064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5beee-eeac-4785-8c48-897de88b411b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.888072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4f1d4-9fdb-4010-981e-4a50a3f2524d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.949302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662587d-fd69-4775-a82e-97b7677f8b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.950342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662587d-fd69-4775-a82e-97b7677f8b25 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.950805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662587d-fd69-4775-a82e-97b7677f8b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.951254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662587d-fd69-4775-a82e-97b7677f8b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.952366 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662587d-fd69-4775-a82e-97b7677f8b25 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:53.953391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5beee-eeac-4785-8c48-897de88b411b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.953638 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662587d-fd69-4775-a82e-97b7677f8b25 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.955720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662587d-fd69-4775-a82e-97b7677f8b25 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.958269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7770b3b-4270-44f4-b399-e5acb3f6b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:53.959233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7770b3b-4270-44f4-b399-e5acb3f6b655 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:53.959577 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7770b3b-4270-44f4-b399-e5acb3f6b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:53.959915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7770b3b-4270-44f4-b399-e5acb3f6b655 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:53.969253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 302/586] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:53.971746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7770b3b-4270-44f4-b399-e5acb3f6b655 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:53.976153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7770b3b-4270-44f4-b399-e5acb3f6b655 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:53.977421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662587d-fd69-4775-a82e-97b7677f8b25 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:53.992403 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662587d-fd69-4775-a82e-97b7677f8b25 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:53.998102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-a7770b3b-4270-44f4-b399-e5acb3f6b655 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:53.998102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 285/587] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:54.001539 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7770b3b-4270-44f4-b399-e5acb3f6b655 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.007047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f57b5a-25c7-45e8-a82b-c6d95cd6bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.008321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f57b5a-25c7-45e8-a82b-c6d95cd6bd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.008851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f57b5a-25c7-45e8-a82b-c6d95cd6bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.009305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f57b5a-25c7-45e8-a82b-c6d95cd6bd05 admin admin] PATH_INFO: `/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/5074090dca0b4a49b54dc252a5dd9420/roles/068cd8712b8547b89967dd5d7964007b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.019614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7770b3b-4270-44f4-b399-e5acb3f6b655 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.030974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23088a21-2db4-4c40-8ff7-66f18117745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.030974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23088a21-2db4-4c40-8ff7-66f18117745d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.030974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23088a21-2db4-4c40-8ff7-66f18117745d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.030974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23088a21-2db4-4c40-8ff7-66f18117745d admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.031566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23088a21-2db4-4c40-8ff7-66f18117745d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:54.031566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23088a21-2db4-4c40-8ff7-66f18117745d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.031566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23088a21-2db4-4c40-8ff7-66f18117745d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.045724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f57b5a-25c7-45e8-a82b-c6d95cd6bd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ab51e6e2745658b252fbafdc2f8ef, user_id=5074090dca0b4a49b54dc252a5dd9420, role_id=068cd8712b8547b89967dd5d7964007b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.049398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 286/588] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:54.049712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f57b5a-25c7-45e8-a82b-c6d95cd6bd05 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.060051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23088a21-2db4-4c40-8ff7-66f18117745d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.066430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23088a21-2db4-4c40-8ff7-66f18117745d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.071401 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdbed6-6a4b-4211-b550-68b8500759eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.072385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdbed6-6a4b-4211-b550-68b8500759eb admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.072773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdbed6-6a4b-4211-b550-68b8500759eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.073110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdbed6-6a4b-4211-b550-68b8500759eb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.082572 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bdbed6-6a4b-4211-b550-68b8500759eb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.088069 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bdbed6-6a4b-4211-b550-68b8500759eb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.090744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 303/589] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:53 2022] PUT /identity/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/5074090dca0b4a49b54dc252a5dd9420/roles/068cd8712b8547b89967dd5d7964007b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:54.101471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-e6bdbed6-6a4b-4211-b550-68b8500759eb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:54.103122 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 287/590] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:54.109660 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f57b5a-25c7-45e8-a82b-c6d95cd6bd05 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.178606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f57b5a-25c7-45e8-a82b-c6d95cd6bd05 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.183383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fe1a3-87fe-44ce-83dd-8ec07748414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.184092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fe1a3-87fe-44ce-83dd-8ec07748414b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.184375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fe1a3-87fe-44ce-83dd-8ec07748414b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.184648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fe1a3-87fe-44ce-83dd-8ec07748414b admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.185450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fe1a3-87fe-44ce-83dd-8ec07748414b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:54.185814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fe1a3-87fe-44ce-83dd-8ec07748414b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.188580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fe1a3-87fe-44ce-83dd-8ec07748414b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.202198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 304/591] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:54.209241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdbed6-6a4b-4211-b550-68b8500759eb admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.220078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdbed6-6a4b-4211-b550-68b8500759eb admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.226009 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf408e-a9c1-45ba-b069-19b62de851ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.226969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf408e-a9c1-45ba-b069-19b62de851ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.227247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf408e-a9c1-45ba-b069-19b62de851ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.227517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf408e-a9c1-45ba-b069-19b62de851ba admin admin] PATH_INFO: `/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/39d5d18c09054343b4e000950ba875fc/roles/068cd8712b8547b89967dd5d7964007b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.235347 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a978789-d589-4fe2-b0c4-a23ddbcd6896 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.235745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a978789-d589-4fe2-b0c4-a23ddbcd6896 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.236358 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a978789-d589-4fe2-b0c4-a23ddbcd6896 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.239137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 305/592] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:54.244850 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2824157-eb13-48aa-94f5-cbbe4a16f7f4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.245142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2824157-eb13-48aa-94f5-cbbe4a16f7f4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.245397 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2824157-eb13-48aa-94f5-cbbe4a16f7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.246680 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf408e-a9c1-45ba-b069-19b62de851ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ab51e6e2745658b252fbafdc2f8ef, user_id=39d5d18c09054343b4e000950ba875fc, role_id=068cd8712b8547b89967dd5d7964007b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.252320 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf408e-a9c1-45ba-b069-19b62de851ba admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.268656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a2824157-eb13-48aa-94f5-cbbe4a16f7f4 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:54.269338 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 288/593] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:54 2022] PUT /identity/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/39d5d18c09054343b4e000950ba875fc/roles/068cd8712b8547b89967dd5d7964007b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:14:54.270158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a2824157-eb13-48aa-94f5-cbbe4a16f7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:54.369815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 306/594] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 09:14:54.395168 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf408e-a9c1-45ba-b069-19b62de851ba admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.409871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf408e-a9c1-45ba-b069-19b62de851ba admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.417028 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e13b9-0f02-401c-9ea2-74acb1136653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.418286 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e13b9-0f02-401c-9ea2-74acb1136653 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.418861 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e13b9-0f02-401c-9ea2-74acb1136653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.419340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e13b9-0f02-401c-9ea2-74acb1136653 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.445093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e13b9-0f02-401c-9ea2-74acb1136653 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:54.452057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-b36e13b9-0f02-401c-9ea2-74acb1136653 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:54.454136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 289/595] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:54.460238 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2824157-eb13-48aa-94f5-cbbe4a16f7f4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.470510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2824157-eb13-48aa-94f5-cbbe4a16f7f4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.481931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4943b37-ec03-4773-9fbb-a886c1a1adca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.482127 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4943b37-ec03-4773-9fbb-a886c1a1adca admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.482373 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4943b37-ec03-4773-9fbb-a886c1a1adca admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.482571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4943b37-ec03-4773-9fbb-a886c1a1adca admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.483527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4943b37-ec03-4773-9fbb-a886c1a1adca admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:54.483858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4943b37-ec03-4773-9fbb-a886c1a1adca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.485504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4943b37-ec03-4773-9fbb-a886c1a1adca admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.494733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 307/596] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:54.500210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e13b9-0f02-401c-9ea2-74acb1136653 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.513592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e13b9-0f02-401c-9ea2-74acb1136653 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.521833 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e8db1-9d50-49ce-b47b-488f5618f140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.522628 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e8db1-9d50-49ce-b47b-488f5618f140 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.522909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e8db1-9d50-49ce-b47b-488f5618f140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.523211 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e8db1-9d50-49ce-b47b-488f5618f140 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.540328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e8db1-9d50-49ce-b47b-488f5618f140 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.542203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e8db1-9d50-49ce-b47b-488f5618f140 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.565594 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-274e8db1-9d50-49ce-b47b-488f5618f140 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:54.567482 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 290/597] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:54.572633 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4943b37-ec03-4773-9fbb-a886c1a1adca admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.595341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4943b37-ec03-4773-9fbb-a886c1a1adca admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.609936 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f3246-71d7-4699-9246-5d5d5b0d4ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.610610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f3246-71d7-4699-9246-5d5d5b0d4ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.610890 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f3246-71d7-4699-9246-5d5d5b0d4ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.611159 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f3246-71d7-4699-9246-5d5d5b0d4ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.611876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f3246-71d7-4699-9246-5d5d5b0d4ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:54.612208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f3246-71d7-4699-9246-5d5d5b0d4ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.613813 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f3246-71d7-4699-9246-5d5d5b0d4ce0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.636858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 308/598] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:54.643383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e8db1-9d50-49ce-b47b-488f5618f140 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.657401 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e8db1-9d50-49ce-b47b-488f5618f140 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.662383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00a722-21d9-4adf-865f-9cc7e41a196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.663453 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00a722-21d9-4adf-865f-9cc7e41a196d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.663969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00a722-21d9-4adf-865f-9cc7e41a196d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.664543 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00a722-21d9-4adf-865f-9cc7e41a196d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.680606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00a722-21d9-4adf-865f-9cc7e41a196d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.682961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00a722-21d9-4adf-865f-9cc7e41a196d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.700074 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-aa00a722-21d9-4adf-865f-9cc7e41a196d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 09:14:54.701645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 291/599] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:54.707305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f3246-71d7-4699-9246-5d5d5b0d4ce0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.724995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f3246-71d7-4699-9246-5d5d5b0d4ce0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.737494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a7c39-88da-4eb4-8284-fdd65c7dec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.738187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a7c39-88da-4eb4-8284-fdd65c7dec09 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.738472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a7c39-88da-4eb4-8284-fdd65c7dec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.738746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a7c39-88da-4eb4-8284-fdd65c7dec09 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.739722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a7c39-88da-4eb4-8284-fdd65c7dec09 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:54.740165 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a7c39-88da-4eb4-8284-fdd65c7dec09 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.742051 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a7c39-88da-4eb4-8284-fdd65c7dec09 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.771694 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 309/600] 10.222.0.90 () {56 vars in 1156 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:54.777184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00a722-21d9-4adf-865f-9cc7e41a196d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.789073 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00a722-21d9-4adf-865f-9cc7e41a196d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.796769 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cfdc5-a0f1-4935-af26-25cd2756b795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.797414 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cfdc5-a0f1-4935-af26-25cd2756b795 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.797695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cfdc5-a0f1-4935-af26-25cd2756b795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.797973 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30cfdc5-a0f1-4935-af26-25cd2756b795 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.811796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cfdc5-a0f1-4935-af26-25cd2756b795 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.813578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30cfdc5-a0f1-4935-af26-25cd2756b795 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.828186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 292/601] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:54.833761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a7c39-88da-4eb4-8284-fdd65c7dec09 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.855374 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a7c39-88da-4eb4-8284-fdd65c7dec09 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.863308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82b38d-634f-4514-93fa-f719926dbef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.864112 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b38d-634f-4514-93fa-f719926dbef5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.864392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b38d-634f-4514-93fa-f719926dbef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.864666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b38d-634f-4514-93fa-f719926dbef5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.883625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82b38d-634f-4514-93fa-f719926dbef5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.885508 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82b38d-634f-4514-93fa-f719926dbef5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.912293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-2a82b38d-634f-4514-93fa-f719926dbef5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:54.913442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 310/602] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:54.918979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cfdc5-a0f1-4935-af26-25cd2756b795 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.933353 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30cfdc5-a0f1-4935-af26-25cd2756b795 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:54.946617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd0230-ad5e-4e76-8af1-73e6610e2c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:54.947378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd0230-ad5e-4e76-8af1-73e6610e2c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:54.947660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd0230-ad5e-4e76-8af1-73e6610e2c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:54.947996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd0230-ad5e-4e76-8af1-73e6610e2c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:54.948869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd0230-ad5e-4e76-8af1-73e6610e2c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:54.949231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd0230-ad5e-4e76-8af1-73e6610e2c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:54.950821 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd0230-ad5e-4e76-8af1-73e6610e2c40 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:54.973288 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 293/603] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:54.978271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82b38d-634f-4514-93fa-f719926dbef5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:54.992967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82b38d-634f-4514-93fa-f719926dbef5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:55.004645 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f36ec2-cb42-494f-93f1-eada53bc843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:55.005435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f36ec2-cb42-494f-93f1-eada53bc843f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:55.005721 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f36ec2-cb42-494f-93f1-eada53bc843f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:55.005998 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f36ec2-cb42-494f-93f1-eada53bc843f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:55.017195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f36ec2-cb42-494f-93f1-eada53bc843f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:55.019184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f36ec2-cb42-494f-93f1-eada53bc843f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:55.040961 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-59f36ec2-cb42-494f-93f1-eada53bc843f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:55.042615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 311/604] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:55.048740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd0230-ad5e-4e76-8af1-73e6610e2c40 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:55.070510 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd0230-ad5e-4e76-8af1-73e6610e2c40 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:55.077902 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db8d7b-e8e0-4116-986c-392606467438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:55.078674 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db8d7b-e8e0-4116-986c-392606467438 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:55.078952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db8d7b-e8e0-4116-986c-392606467438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:55.079224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db8d7b-e8e0-4116-986c-392606467438 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:55.080081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db8d7b-e8e0-4116-986c-392606467438 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:55.080390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db8d7b-e8e0-4116-986c-392606467438 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:55.082311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db8d7b-e8e0-4116-986c-392606467438 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:55.101392 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 294/605] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:55.108238 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f36ec2-cb42-494f-93f1-eada53bc843f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:55.130485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f36ec2-cb42-494f-93f1-eada53bc843f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:55.144503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394ca78-8522-47af-b5f8-85cce3da18e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:55.145157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394ca78-8522-47af-b5f8-85cce3da18e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:55.145437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394ca78-8522-47af-b5f8-85cce3da18e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:55.145710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394ca78-8522-47af-b5f8-85cce3da18e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:55.146544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394ca78-8522-47af-b5f8-85cce3da18e3 admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=faf1f200fb2b4a2fb75b971054885eef) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:55.146851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394ca78-8522-47af-b5f8-85cce3da18e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:55.148724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394ca78-8522-47af-b5f8-85cce3da18e3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:55.160151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 312/606] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:55 2022] GET /identity/v3/role_assignments?user.id=faf1f200fb2b4a2fb75b971054885eef&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:56.262111 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366f200-ff7c-403c-83c4-12645567efd2 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.262860 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366f200-ff7c-403c-83c4-12645567efd2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.262860 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366f200-ff7c-403c-83c4-12645567efd2 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.265463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 295/607] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:56.270717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f34b8-fe76-4118-961b-d56aa518a3f4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.271259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f34b8-fe76-4118-961b-d56aa518a3f4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.271259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f34b8-fe76-4118-961b-d56aa518a3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.296641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d10f34b8-fe76-4118-961b-d56aa518a3f4 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:56.297850 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d10f34b8-fe76-4118-961b-d56aa518a3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:56.305495 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 313/608] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:56.346199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366f200-ff7c-403c-83c4-12645567efd2 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:56.361572 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366f200-ff7c-403c-83c4-12645567efd2 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:56.366032 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71a0a-5294-4e15-9854-bcd398abe07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:56.366808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71a0a-5294-4e15-9854-bcd398abe07f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.367087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71a0a-5294-4e15-9854-bcd398abe07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.367365 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71a0a-5294-4e15-9854-bcd398abe07f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.391486 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f71a0a-5294-4e15-9854-bcd398abe07f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:56.398736 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-f2f71a0a-5294-4e15-9854-bcd398abe07f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:56.400001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 296/609] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:56.406723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f34b8-fe76-4118-961b-d56aa518a3f4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:56.421740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f34b8-fe76-4118-961b-d56aa518a3f4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:56.429561 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29514338-4579-4fb9-9b0e-c75997ed1e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:56.430232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29514338-4579-4fb9-9b0e-c75997ed1e80 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.430507 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29514338-4579-4fb9-9b0e-c75997ed1e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.430774 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29514338-4579-4fb9-9b0e-c75997ed1e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.431523 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29514338-4579-4fb9-9b0e-c75997ed1e80 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:56.431824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29514338-4579-4fb9-9b0e-c75997ed1e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:56.433442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29514338-4579-4fb9-9b0e-c75997ed1e80 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:56.447557 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 314/610] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:56.453883 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71a0a-5294-4e15-9854-bcd398abe07f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:56.464330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71a0a-5294-4e15-9854-bcd398abe07f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:56.474844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc4787-b9ab-4c03-8ddf-0a559bc3c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:56.475666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc4787-b9ab-4c03-8ddf-0a559bc3c2da admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.475949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc4787-b9ab-4c03-8ddf-0a559bc3c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.476250 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc4787-b9ab-4c03-8ddf-0a559bc3c2da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.487639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc4787-b9ab-4c03-8ddf-0a559bc3c2da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:56.489498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc4787-b9ab-4c03-8ddf-0a559bc3c2da admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:56.515409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-8ddc4787-b9ab-4c03-8ddf-0a559bc3c2da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:56.517710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 297/611] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:56.522313 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29514338-4579-4fb9-9b0e-c75997ed1e80 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:56.537034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29514338-4579-4fb9-9b0e-c75997ed1e80 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:56.549723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4779-7e6f-48f0-97dd-2dbfdf25ca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:56.550443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4779-7e6f-48f0-97dd-2dbfdf25ca63 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.550724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4779-7e6f-48f0-97dd-2dbfdf25ca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.550996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4779-7e6f-48f0-97dd-2dbfdf25ca63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.551720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f4779-7e6f-48f0-97dd-2dbfdf25ca63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:56.552017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f4779-7e6f-48f0-97dd-2dbfdf25ca63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:56.553644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f4779-7e6f-48f0-97dd-2dbfdf25ca63 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:56.575329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 315/612] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:56.581720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc4787-b9ab-4c03-8ddf-0a559bc3c2da admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:56.597918 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc4787-b9ab-4c03-8ddf-0a559bc3c2da admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:56.608256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8699d-b0bf-4851-b021-355684bc5173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:56.609109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8699d-b0bf-4851-b021-355684bc5173 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.609387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8699d-b0bf-4851-b021-355684bc5173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.609659 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8699d-b0bf-4851-b021-355684bc5173 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.623899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8699d-b0bf-4851-b021-355684bc5173 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:56.625984 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8699d-b0bf-4851-b021-355684bc5173 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:56.650036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-2da8699d-b0bf-4851-b021-355684bc5173 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 09:14:56.651233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 298/613] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:56.657448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4779-7e6f-48f0-97dd-2dbfdf25ca63 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:56.670620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4779-7e6f-48f0-97dd-2dbfdf25ca63 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:56.681198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ab9cc-fec3-455b-991f-279bb360df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:56.681901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ab9cc-fec3-455b-991f-279bb360df15 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.682181 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ab9cc-fec3-455b-991f-279bb360df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.682449 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ab9cc-fec3-455b-991f-279bb360df15 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.683330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ab9cc-fec3-455b-991f-279bb360df15 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:56.683636 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ab9cc-fec3-455b-991f-279bb360df15 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:56.685534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ab9cc-fec3-455b-991f-279bb360df15 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:56.715980 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 316/614] 10.222.0.90 () {56 vars in 1154 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:56.721885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8699d-b0bf-4851-b021-355684bc5173 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:56.737318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8699d-b0bf-4851-b021-355684bc5173 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:56.748839 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd84f6d-ec71-423a-8685-0420d8e40c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:56.749730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd84f6d-ec71-423a-8685-0420d8e40c7c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.750055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd84f6d-ec71-423a-8685-0420d8e40c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.750328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd84f6d-ec71-423a-8685-0420d8e40c7c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.754316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd6e40-a939-40ca-881f-193f59c2d0e6 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.754604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd6e40-a939-40ca-881f-193f59c2d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.754875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd6e40-a939-40ca-881f-193f59c2d0e6 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.756662 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 317/615] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:14:56.760474 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd84f6d-ec71-423a-8685-0420d8e40c7c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:56.762517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd84f6d-ec71-423a-8685-0420d8e40c7c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:56.777232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 299/616] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:56.777740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dd824-8be9-4b24-80eb-61fa2207dc16 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.778025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dd824-8be9-4b24-80eb-61fa2207dc16 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.778299 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253dd824-8be9-4b24-80eb-61fa2207dc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.783379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd84f6d-ec71-423a-8685-0420d8e40c7c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:56.793680 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd84f6d-ec71-423a-8685-0420d8e40c7c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:56.807546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24529d51-286e-4a06-8b12-4b8b0280d7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:56.808461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24529d51-286e-4a06-8b12-4b8b0280d7bc admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.808737 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24529d51-286e-4a06-8b12-4b8b0280d7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.809006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24529d51-286e-4a06-8b12-4b8b0280d7bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.812607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-253dd824-8be9-4b24-80eb-61fa2207dc16 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:56.813929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-253dd824-8be9-4b24-80eb-61fa2207dc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:56.829753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 318/617] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:56.837238 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24529d51-286e-4a06-8b12-4b8b0280d7bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:56.839128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24529d51-286e-4a06-8b12-4b8b0280d7bc admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:56.857036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dd824-8be9-4b24-80eb-61fa2207dc16 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:56.864159 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-24529d51-286e-4a06-8b12-4b8b0280d7bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:56.864159 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 300/618] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:56.869310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253dd824-8be9-4b24-80eb-61fa2207dc16 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:56.870290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24529d51-286e-4a06-8b12-4b8b0280d7bc admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:56.881734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24529d51-286e-4a06-8b12-4b8b0280d7bc admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:56.886794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0150103-724c-4df1-877b-3a0253479dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:56.887671 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0150103-724c-4df1-877b-3a0253479dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.888124 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0150103-724c-4df1-877b-3a0253479dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.888668 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0150103-724c-4df1-877b-3a0253479dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.889267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6e134-0dc8-47ea-9575-8a95373d995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:56.890419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0150103-724c-4df1-877b-3a0253479dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:56.890648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6e134-0dc8-47ea-9575-8a95373d995e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.890926 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6e134-0dc8-47ea-9575-8a95373d995e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.891192 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6e134-0dc8-47ea-9575-8a95373d995e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.891396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0150103-724c-4df1-877b-3a0253479dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:56.893304 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0150103-724c-4df1-877b-3a0253479dcc admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:56.906728 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 301/619] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:56.916063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6e134-0dc8-47ea-9575-8a95373d995e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:56.917207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0150103-724c-4df1-877b-3a0253479dcc admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:56.928051 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-16c6e134-0dc8-47ea-9575-8a95373d995e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:56.928051 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 319/620] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:56.932469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6e134-0dc8-47ea-9575-8a95373d995e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:56.939199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0150103-724c-4df1-877b-3a0253479dcc admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:56.950332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d79885-7790-44dc-ae82-b0a2dac80550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:56.951174 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d79885-7790-44dc-ae82-b0a2dac80550 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.951452 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d79885-7790-44dc-ae82-b0a2dac80550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.951717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d79885-7790-44dc-ae82-b0a2dac80550 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.953552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6e134-0dc8-47ea-9575-8a95373d995e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:56.964152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191aef6e-d2a5-4a64-9f24-c10a72ce6d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:56.964922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191aef6e-d2a5-4a64-9f24-c10a72ce6d07 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:56.965197 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191aef6e-d2a5-4a64-9f24-c10a72ce6d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:56.966197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d79885-7790-44dc-ae82-b0a2dac80550 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:56.966594 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191aef6e-d2a5-4a64-9f24-c10a72ce6d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:56.967428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191aef6e-d2a5-4a64-9f24-c10a72ce6d07 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:56.967733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191aef6e-d2a5-4a64-9f24-c10a72ce6d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:56.971286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191aef6e-d2a5-4a64-9f24-c10a72ce6d07 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:56.972260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d79885-7790-44dc-ae82-b0a2dac80550 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:56.989842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 320/621] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:56.994992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191aef6e-d2a5-4a64-9f24-c10a72ce6d07 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.005326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-a7d79885-7790-44dc-ae82-b0a2dac80550 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:57.007011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 302/622] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.008710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0863b-d773-463b-9f46-c91d91ae2584 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.009094 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0863b-d773-463b-9f46-c91d91ae2584 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.009202 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191aef6e-d2a5-4a64-9f24-c10a72ce6d07 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.009554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0863b-d773-463b-9f46-c91d91ae2584 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.011546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 303/623] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:57.018613 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad0a80-77da-46e3-9118-284b044e1c18 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.019106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad0a80-77da-46e3-9118-284b044e1c18 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.019487 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c247da-1513-463b-98f9-e37089e84ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.019858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad0a80-77da-46e3-9118-284b044e1c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.020360 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c247da-1513-463b-98f9-e37089e84ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.020638 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c247da-1513-463b-98f9-e37089e84ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.020963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c247da-1513-463b-98f9-e37089e84ea4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.035124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c247da-1513-463b-98f9-e37089e84ea4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.035124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c247da-1513-463b-98f9-e37089e84ea4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.042616 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-54ad0a80-77da-46e3-9118-284b044e1c18 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:57.044102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-54ad0a80-77da-46e3-9118-284b044e1c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:57.053075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 304/624] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:57.054195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad0a80-77da-46e3-9118-284b044e1c18 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.054302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-b3c247da-1513-463b-98f9-e37089e84ea4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:57.055859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 321/625] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:57.064660 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c247da-1513-463b-98f9-e37089e84ea4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.069183 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad0a80-77da-46e3-9118-284b044e1c18 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.075908 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c247da-1513-463b-98f9-e37089e84ea4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.077746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fe5d5-65b9-431b-b0de-762ec3bde3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.078749 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe5d5-65b9-431b-b0de-762ec3bde3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.079267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe5d5-65b9-431b-b0de-762ec3bde3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.079676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe5d5-65b9-431b-b0de-762ec3bde3f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.080713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fe5d5-65b9-431b-b0de-762ec3bde3f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.081158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fe5d5-65b9-431b-b0de-762ec3bde3f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.081383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44347b1b-dae6-4e01-9b5e-fbdfef342bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.082145 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44347b1b-dae6-4e01-9b5e-fbdfef342bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.082517 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44347b1b-dae6-4e01-9b5e-fbdfef342bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.082916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44347b1b-dae6-4e01-9b5e-fbdfef342bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.083802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fe5d5-65b9-431b-b0de-762ec3bde3f7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.083911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44347b1b-dae6-4e01-9b5e-fbdfef342bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.084347 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44347b1b-dae6-4e01-9b5e-fbdfef342bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.086104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44347b1b-dae6-4e01-9b5e-fbdfef342bb0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.097342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 305/626] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.098421 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fe5d5-65b9-431b-b0de-762ec3bde3f7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.103712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 322/627] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:57.105007 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44347b1b-dae6-4e01-9b5e-fbdfef342bb0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.109826 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fe5d5-65b9-431b-b0de-762ec3bde3f7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.114844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a12e85-8ea7-4b0b-9f84-11a3d32ab120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.115509 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44347b1b-dae6-4e01-9b5e-fbdfef342bb0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.116010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a12e85-8ea7-4b0b-9f84-11a3d32ab120 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.116578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a12e85-8ea7-4b0b-9f84-11a3d32ab120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.117219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a12e85-8ea7-4b0b-9f84-11a3d32ab120 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.120438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b9eac-4f1c-4263-94f9-d70f19b17a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.121179 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b9eac-4f1c-4263-94f9-d70f19b17a9d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.121559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b9eac-4f1c-4263-94f9-d70f19b17a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.121895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b9eac-4f1c-4263-94f9-d70f19b17a9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.122819 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b9eac-4f1c-4263-94f9-d70f19b17a9d admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=9801d0694ec54d65bdd5b8914e05637e) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.123184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b9eac-4f1c-4263-94f9-d70f19b17a9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.125450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b9eac-4f1c-4263-94f9-d70f19b17a9d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.129534 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a12e85-8ea7-4b0b-9f84-11a3d32ab120 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:57.136647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-57a12e85-8ea7-4b0b-9f84-11a3d32ab120 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:57.138405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 306/629] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.138511 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 323/629] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/role_assignments?user.id=9801d0694ec54d65bdd5b8914e05637e&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:57.143615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b9eac-4f1c-4263-94f9-d70f19b17a9d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.145034 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a12e85-8ea7-4b0b-9f84-11a3d32ab120 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.153808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b9eac-4f1c-4263-94f9-d70f19b17a9d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.156182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a12e85-8ea7-4b0b-9f84-11a3d32ab120 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.161406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cd2d7-f675-4a54-9258-0ad1fb472a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.162494 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cd2d7-f675-4a54-9258-0ad1fb472a57 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.163061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cd2d7-f675-4a54-9258-0ad1fb472a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.163612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cd2d7-f675-4a54-9258-0ad1fb472a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.164672 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cd2d7-f675-4a54-9258-0ad1fb472a57 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.165192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cd2d7-f675-4a54-9258-0ad1fb472a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.167117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63a71a-725c-4d65-90fb-cba9ba36f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.167495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cd2d7-f675-4a54-9258-0ad1fb472a57 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.167911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63a71a-725c-4d65-90fb-cba9ba36f9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.168254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63a71a-725c-4d65-90fb-cba9ba36f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.168527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63a71a-725c-4d65-90fb-cba9ba36f9c8 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.181269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63a71a-725c-4d65-90fb-cba9ba36f9c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.183367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63a71a-725c-4d65-90fb-cba9ba36f9c8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.185953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 307/630] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.188264 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a30ac8-7caa-43b1-8df7-fd269fb4b54e None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.188789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a30ac8-7caa-43b1-8df7-fd269fb4b54e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.189285 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a30ac8-7caa-43b1-8df7-fd269fb4b54e None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.191557 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 308/631] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:57.195760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a30ac8-7caa-43b1-8df7-fd269fb4b54e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.208018 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-af63a71a-725c-4d65-90fb-cba9ba36f9c8 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 09:14:57.209521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 324/632] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.210355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a30ac8-7caa-43b1-8df7-fd269fb4b54e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.210668 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c29bf2-774e-4beb-826e-3ccd5ace9878 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.210957 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c29bf2-774e-4beb-826e-3ccd5ace9878 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.211291 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c29bf2-774e-4beb-826e-3ccd5ace9878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.215901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d962112-89c3-44fb-b8ba-ec9c963c490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.216980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d962112-89c3-44fb-b8ba-ec9c963c490d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.217467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d962112-89c3-44fb-b8ba-ec9c963c490d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.217962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d962112-89c3-44fb-b8ba-ec9c963c490d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.229207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d962112-89c3-44fb-b8ba-ec9c963c490d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.231283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-58c29bf2-774e-4beb-826e-3ccd5ace9878 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:57.231617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d962112-89c3-44fb-b8ba-ec9c963c490d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.232775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-58c29bf2-774e-4beb-826e-3ccd5ace9878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:57.248444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 325/633] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:57.250154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c29bf2-774e-4beb-826e-3ccd5ace9878 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.253544 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-7d962112-89c3-44fb-b8ba-ec9c963c490d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:57.255336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 309/634] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.269074 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d962112-89c3-44fb-b8ba-ec9c963c490d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.269699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c29bf2-774e-4beb-826e-3ccd5ace9878 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.274186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feba8ff-6c6a-4cb4-8953-e9cddf09902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.274858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feba8ff-6c6a-4cb4-8953-e9cddf09902f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.275142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feba8ff-6c6a-4cb4-8953-e9cddf09902f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.275415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feba8ff-6c6a-4cb4-8953-e9cddf09902f admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.276376 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feba8ff-6c6a-4cb4-8953-e9cddf09902f admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.276777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feba8ff-6c6a-4cb4-8953-e9cddf09902f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.284052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feba8ff-6c6a-4cb4-8953-e9cddf09902f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.290605 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d962112-89c3-44fb-b8ba-ec9c963c490d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.299354 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a0fa4-44ca-4041-b474-8f1f26294a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.300053 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a0fa4-44ca-4041-b474-8f1f26294a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.300335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a0fa4-44ca-4041-b474-8f1f26294a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.300592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a0fa4-44ca-4041-b474-8f1f26294a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.301311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a0fa4-44ca-4041-b474-8f1f26294a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.301608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a0fa4-44ca-4041-b474-8f1f26294a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.303219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a0fa4-44ca-4041-b474-8f1f26294a8d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.306219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 326/635] 10.222.0.90 () {56 vars in 1158 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.307370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feba8ff-6c6a-4cb4-8953-e9cddf09902f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.317722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 310/636] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.318417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a0fa4-44ca-4041-b474-8f1f26294a8d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.323157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feba8ff-6c6a-4cb4-8953-e9cddf09902f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.335133 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a0fa4-44ca-4041-b474-8f1f26294a8d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.336997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a57541-bdf9-4484-8e1c-06aa6a2cef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.337814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a57541-bdf9-4484-8e1c-06aa6a2cef92 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.338085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a57541-bdf9-4484-8e1c-06aa6a2cef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.338356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a57541-bdf9-4484-8e1c-06aa6a2cef92 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.344824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c05b6-de54-493d-9103-df0f8fc943d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.345847 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c05b6-de54-493d-9103-df0f8fc943d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.346552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c05b6-de54-493d-9103-df0f8fc943d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.347112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c05b6-de54-493d-9103-df0f8fc943d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.351164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a57541-bdf9-4484-8e1c-06aa6a2cef92 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:57.356711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c05b6-de54-493d-9103-df0f8fc943d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.358011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-61a57541-bdf9-4484-8e1c-06aa6a2cef92 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:57.359753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 327/637] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.360171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c05b6-de54-493d-9103-df0f8fc943d7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.360543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a57541-bdf9-4484-8e1c-06aa6a2cef92 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.370643 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a57541-bdf9-4484-8e1c-06aa6a2cef92 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.371074 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 311/638] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:57.372275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c05b6-de54-493d-9103-df0f8fc943d7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.381552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d5abc-137d-4fee-a590-f9671685ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.382023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c05b6-de54-493d-9103-df0f8fc943d7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.382337 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d5abc-137d-4fee-a590-f9671685ef27 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.382646 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d5abc-137d-4fee-a590-f9671685ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.382881 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d5abc-137d-4fee-a590-f9671685ef27 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.387292 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5150f1f-185e-4352-ac76-2fce760b731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.387941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5150f1f-185e-4352-ac76-2fce760b731c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.388269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5150f1f-185e-4352-ac76-2fce760b731c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.388548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5150f1f-185e-4352-ac76-2fce760b731c admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.389278 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5150f1f-185e-4352-ac76-2fce760b731c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.389584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5150f1f-185e-4352-ac76-2fce760b731c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.391726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5150f1f-185e-4352-ac76-2fce760b731c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.391985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d5abc-137d-4fee-a590-f9671685ef27 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.394066 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d5abc-137d-4fee-a590-f9671685ef27 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.402772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 312/639] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.402772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5150f1f-185e-4352-ac76-2fce760b731c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.410597 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e29d5abc-137d-4fee-a590-f9671685ef27 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 16 09:14:57.412964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 328/640] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.414223 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d5abc-137d-4fee-a590-f9671685ef27 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.416193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5150f1f-185e-4352-ac76-2fce760b731c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.421728 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecec32b-0d2e-4163-9102-14f4b5776071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.422252 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecec32b-0d2e-4163-9102-14f4b5776071 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.422530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecec32b-0d2e-4163-9102-14f4b5776071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.422799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecec32b-0d2e-4163-9102-14f4b5776071 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.427136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d5abc-137d-4fee-a590-f9671685ef27 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.433434 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53982c-14ba-4fd5-a705-18f79ef54ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.434707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53982c-14ba-4fd5-a705-18f79ef54ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.434817 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecec32b-0d2e-4163-9102-14f4b5776071 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.435322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53982c-14ba-4fd5-a705-18f79ef54ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.435785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53982c-14ba-4fd5-a705-18f79ef54ea3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.438371 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecec32b-0d2e-4163-9102-14f4b5776071 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.452930 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53982c-14ba-4fd5-a705-18f79ef54ea3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.455300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53982c-14ba-4fd5-a705-18f79ef54ea3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.456909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-fecec32b-0d2e-4163-9102-14f4b5776071 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:57.457988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 313/641] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.459392 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecec32b-0d2e-4163-9102-14f4b5776071 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.473946 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecec32b-0d2e-4163-9102-14f4b5776071 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.477274 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-3f53982c-14ba-4fd5-a705-18f79ef54ea3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:57.478633 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 329/642] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.478748 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe95adf-4ab2-40dc-876c-51cb0ec4fa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.479175 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe95adf-4ab2-40dc-876c-51cb0ec4fa19 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.479275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53982c-14ba-4fd5-a705-18f79ef54ea3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.479627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe95adf-4ab2-40dc-876c-51cb0ec4fa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.479726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe95adf-4ab2-40dc-876c-51cb0ec4fa19 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.480667 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe95adf-4ab2-40dc-876c-51cb0ec4fa19 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.480938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe95adf-4ab2-40dc-876c-51cb0ec4fa19 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.483855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe95adf-4ab2-40dc-876c-51cb0ec4fa19 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.492240 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53982c-14ba-4fd5-a705-18f79ef54ea3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.499979 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51ecc1-b2ab-4db0-86a7-3be650fa71e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.500683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51ecc1-b2ab-4db0-86a7-3be650fa71e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.500967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51ecc1-b2ab-4db0-86a7-3be650fa71e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.501241 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51ecc1-b2ab-4db0-86a7-3be650fa71e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.501972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51ecc1-b2ab-4db0-86a7-3be650fa71e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.502278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51ecc1-b2ab-4db0-86a7-3be650fa71e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.503890 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51ecc1-b2ab-4db0-86a7-3be650fa71e1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.506607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 314/643] 10.222.0.90 () {56 vars in 1158 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.507680 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe95adf-4ab2-40dc-876c-51cb0ec4fa19 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.518787 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe95adf-4ab2-40dc-876c-51cb0ec4fa19 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.519700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 330/644] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.520421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51ecc1-b2ab-4db0-86a7-3be650fa71e1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.524233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023c50b-8c4b-4d84-8ed1-29ab42d14b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.525061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023c50b-8c4b-4d84-8ed1-29ab42d14b70 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.525346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023c50b-8c4b-4d84-8ed1-29ab42d14b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.525623 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023c50b-8c4b-4d84-8ed1-29ab42d14b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.526337 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023c50b-8c4b-4d84-8ed1-29ab42d14b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.526645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023c50b-8c4b-4d84-8ed1-29ab42d14b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.528268 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023c50b-8c4b-4d84-8ed1-29ab42d14b70 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.533029 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51ecc1-b2ab-4db0-86a7-3be650fa71e1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.537702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7949af-92ce-46fa-8656-e5e5f54618df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.538333 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7949af-92ce-46fa-8656-e5e5f54618df admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.538616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7949af-92ce-46fa-8656-e5e5f54618df admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.538887 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7949af-92ce-46fa-8656-e5e5f54618df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.542377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 315/645] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.543449 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023c50b-8c4b-4d84-8ed1-29ab42d14b70 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.547297 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7949af-92ce-46fa-8656-e5e5f54618df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.549320 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7949af-92ce-46fa-8656-e5e5f54618df admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.554379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023c50b-8c4b-4d84-8ed1-29ab42d14b70 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.558391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 331/646] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:14:57.559077 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218840a3-194d-4e75-b7d2-7cb2202d9691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.559593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7949af-92ce-46fa-8656-e5e5f54618df admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.559921 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218840a3-194d-4e75-b7d2-7cb2202d9691 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.560239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218840a3-194d-4e75-b7d2-7cb2202d9691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.560514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218840a3-194d-4e75-b7d2-7cb2202d9691 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.569823 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7949af-92ce-46fa-8656-e5e5f54618df admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.572939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218840a3-194d-4e75-b7d2-7cb2202d9691 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.574772 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae953d4b-dcc0-4dd9-b905-b251d56adb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.575239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218840a3-194d-4e75-b7d2-7cb2202d9691 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.575931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae953d4b-dcc0-4dd9-b905-b251d56adb14 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.576436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae953d4b-dcc0-4dd9-b905-b251d56adb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.576882 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae953d4b-dcc0-4dd9-b905-b251d56adb14 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.585742 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae953d4b-dcc0-4dd9-b905-b251d56adb14 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.588187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae953d4b-dcc0-4dd9-b905-b251d56adb14 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.591634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-218840a3-194d-4e75-b7d2-7cb2202d9691 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:57.593504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 316/647] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.594244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218840a3-194d-4e75-b7d2-7cb2202d9691 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.606778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-ae953d4b-dcc0-4dd9-b905-b251d56adb14 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 16 09:14:57.608385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 332/648] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.609169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218840a3-194d-4e75-b7d2-7cb2202d9691 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.610458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae953d4b-dcc0-4dd9-b905-b251d56adb14 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.623590 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae953d4b-dcc0-4dd9-b905-b251d56adb14 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.626170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386cfa4-a2c9-4d26-8f57-2a484e115a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.627244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386cfa4-a2c9-4d26-8f57-2a484e115a22 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.627742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386cfa4-a2c9-4d26-8f57-2a484e115a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.628258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386cfa4-a2c9-4d26-8f57-2a484e115a22 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.629449 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaa9d8-7972-4c54-ae7a-13fb3e1e779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.630186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa9d8-7972-4c54-ae7a-13fb3e1e779a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.630566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa9d8-7972-4c54-ae7a-13fb3e1e779a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.631078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa9d8-7972-4c54-ae7a-13fb3e1e779a admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.631824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaa9d8-7972-4c54-ae7a-13fb3e1e779a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.632474 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaa9d8-7972-4c54-ae7a-13fb3e1e779a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.634209 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaa9d8-7972-4c54-ae7a-13fb3e1e779a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.642695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386cfa4-a2c9-4d26-8f57-2a484e115a22 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.645199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386cfa4-a2c9-4d26-8f57-2a484e115a22 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.647569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 333/649] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.652062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaa9d8-7972-4c54-ae7a-13fb3e1e779a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.664764 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaa9d8-7972-4c54-ae7a-13fb3e1e779a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.669477 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040950b-7c3e-433a-82ce-d1512b711193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.669953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-8386cfa4-a2c9-4d26-8f57-2a484e115a22 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:57.670479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040950b-7c3e-433a-82ce-d1512b711193 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.670927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040950b-7c3e-433a-82ce-d1512b711193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.671342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040950b-7c3e-433a-82ce-d1512b711193 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.676422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 317/650] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.676422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386cfa4-a2c9-4d26-8f57-2a484e115a22 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.676641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040950b-7c3e-433a-82ce-d1512b711193 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.676641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040950b-7c3e-433a-82ce-d1512b711193 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.682685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040950b-7c3e-433a-82ce-d1512b711193 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.687073 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386cfa4-a2c9-4d26-8f57-2a484e115a22 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.691863 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404bff0-b1ac-43d0-8e09-1b2332109339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.692537 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404bff0-b1ac-43d0-8e09-1b2332109339 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.692864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404bff0-b1ac-43d0-8e09-1b2332109339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.693139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404bff0-b1ac-43d0-8e09-1b2332109339 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.694058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404bff0-b1ac-43d0-8e09-1b2332109339 admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=96e6c68eee11421bbb6b4066a856f228) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.694369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404bff0-b1ac-43d0-8e09-1b2332109339 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.697185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404bff0-b1ac-43d0-8e09-1b2332109339 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.708098 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 318/651] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/role_assignments?user.id=96e6c68eee11421bbb6b4066a856f228&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.708098 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404bff0-b1ac-43d0-8e09-1b2332109339 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.716991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 334/652] 10.222.0.90 () {56 vars in 1160 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.719127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404bff0-b1ac-43d0-8e09-1b2332109339 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.723497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040950b-7c3e-433a-82ce-d1512b711193 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.724259 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8176a-2af6-4046-b984-c638f07fc01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.725103 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8176a-2af6-4046-b984-c638f07fc01a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.725572 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8176a-2af6-4046-b984-c638f07fc01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.725988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8176a-2af6-4046-b984-c638f07fc01a admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.726886 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8176a-2af6-4046-b984-c638f07fc01a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.727351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8176a-2af6-4046-b984-c638f07fc01a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.729203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8176a-2af6-4046-b984-c638f07fc01a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.736732 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040950b-7c3e-433a-82ce-d1512b711193 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.749931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d1956-a7f9-47dc-bafd-51fb5a6aa088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.750589 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d1956-a7f9-47dc-bafd-51fb5a6aa088 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.750901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d1956-a7f9-47dc-bafd-51fb5a6aa088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.751151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d1956-a7f9-47dc-bafd-51fb5a6aa088 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.760154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 319/653] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.763927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d1956-a7f9-47dc-bafd-51fb5a6aa088 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.767033 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8176a-2af6-4046-b984-c638f07fc01a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.773222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d1956-a7f9-47dc-bafd-51fb5a6aa088 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.783141 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8176a-2af6-4046-b984-c638f07fc01a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.791744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 335/654] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 09:14:57.798490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59c8da-b631-4527-a09b-87235e81940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.799293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59c8da-b631-4527-a09b-87235e81940d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.799574 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59c8da-b631-4527-a09b-87235e81940d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.799854 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59c8da-b631-4527-a09b-87235e81940d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.807697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59c8da-b631-4527-a09b-87235e81940d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.809752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59c8da-b631-4527-a09b-87235e81940d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.813710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d1956-a7f9-47dc-bafd-51fb5a6aa088 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.823224 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d1956-a7f9-47dc-bafd-51fb5a6aa088 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.832842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0813a7-4a16-4e35-84df-0b24e4c0ce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.833642 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0813a7-4a16-4e35-84df-0b24e4c0ce14 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.833921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0813a7-4a16-4e35-84df-0b24e4c0ce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.834246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0813a7-4a16-4e35-84df-0b24e4c0ce14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.845937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-5d59c8da-b631-4527-a09b-87235e81940d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:57.852228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 320/655] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.856447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59c8da-b631-4527-a09b-87235e81940d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.862005 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0813a7-4a16-4e35-84df-0b24e4c0ce14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.865589 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0813a7-4a16-4e35-84df-0b24e4c0ce14 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.876164 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59c8da-b631-4527-a09b-87235e81940d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.886231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578913d-116d-4fba-9d33-00106d3180c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.886948 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578913d-116d-4fba-9d33-00106d3180c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.887229 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578913d-116d-4fba-9d33-00106d3180c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.887503 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578913d-116d-4fba-9d33-00106d3180c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.889794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578913d-116d-4fba-9d33-00106d3180c1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.892333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578913d-116d-4fba-9d33-00106d3180c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.896442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578913d-116d-4fba-9d33-00106d3180c1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.900795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-be0813a7-4a16-4e35-84df-0b24e4c0ce14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:57.907574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 336/656] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:57.909104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0813a7-4a16-4e35-84df-0b24e4c0ce14 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.924959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0813a7-4a16-4e35-84df-0b24e4c0ce14 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.925850 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 321/657] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:57.929103 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578913d-116d-4fba-9d33-00106d3180c1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.937263 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127c8c9-d4c0-4027-8986-8ce51c5dd692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.937263 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c8c9-d4c0-4027-8986-8ce51c5dd692 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.938114 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c8c9-d4c0-4027-8986-8ce51c5dd692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.938967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127c8c9-d4c0-4027-8986-8ce51c5dd692 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.939132 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127c8c9-d4c0-4027-8986-8ce51c5dd692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.939874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127c8c9-d4c0-4027-8986-8ce51c5dd692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.941032 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127c8c9-d4c0-4027-8986-8ce51c5dd692 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.942737 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578913d-116d-4fba-9d33-00106d3180c1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.947656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e84de5-908f-46aa-b05e-98275014ed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.948556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e84de5-908f-46aa-b05e-98275014ed98 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.949056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e84de5-908f-46aa-b05e-98275014ed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.949525 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e84de5-908f-46aa-b05e-98275014ed98 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.950539 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e84de5-908f-46aa-b05e-98275014ed98 admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=5074090dca0b4a49b54dc252a5dd9420) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:57.951057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e84de5-908f-46aa-b05e-98275014ed98 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.954347 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e84de5-908f-46aa-b05e-98275014ed98 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:57.962232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 337/658] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:57.963362 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 322/659] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/role_assignments?user.id=5074090dca0b4a49b54dc252a5dd9420&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:57.967524 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127c8c9-d4c0-4027-8986-8ce51c5dd692 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:57.980499 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127c8c9-d4c0-4027-8986-8ce51c5dd692 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:57.986739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd3a40-538f-454e-b08a-b1425f410266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:57.987543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd3a40-538f-454e-b08a-b1425f410266 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:57.987823 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd3a40-538f-454e-b08a-b1425f410266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:57.988113 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd3a40-538f-454e-b08a-b1425f410266 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:57.995969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd3a40-538f-454e-b08a-b1425f410266 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:57.998120 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd3a40-538f-454e-b08a-b1425f410266 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.013334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e1dd3a40-538f-454e-b08a-b1425f410266 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:58.015763 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 338/660] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:58.021598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e84de5-908f-46aa-b05e-98275014ed98 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.032989 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e84de5-908f-46aa-b05e-98275014ed98 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.040394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b1b25-0a1d-44ff-9e92-ca8092875ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.041120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b1b25-0a1d-44ff-9e92-ca8092875ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.041402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b1b25-0a1d-44ff-9e92-ca8092875ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.041726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b1b25-0a1d-44ff-9e92-ca8092875ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.042515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b1b25-0a1d-44ff-9e92-ca8092875ae8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:58.042866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b1b25-0a1d-44ff-9e92-ca8092875ae8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:58.044892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b1b25-0a1d-44ff-9e92-ca8092875ae8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.059474 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 323/661] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:58.065499 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd3a40-538f-454e-b08a-b1425f410266 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.076629 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd3a40-538f-454e-b08a-b1425f410266 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.082213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581b2f5-6f28-47a4-a89b-14b1de8c8b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.082934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581b2f5-6f28-47a4-a89b-14b1de8c8b14 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.083214 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581b2f5-6f28-47a4-a89b-14b1de8c8b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.083487 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581b2f5-6f28-47a4-a89b-14b1de8c8b14 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.084420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581b2f5-6f28-47a4-a89b-14b1de8c8b14 admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=39d5d18c09054343b4e000950ba875fc) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:58.084787 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581b2f5-6f28-47a4-a89b-14b1de8c8b14 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:58.086794 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581b2f5-6f28-47a4-a89b-14b1de8c8b14 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.094607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 339/662] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:14:58 2022] GET /identity/v3/role_assignments?user.id=39d5d18c09054343b4e000950ba875fc&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:58.250354 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac345e35-d9ac-4c80-9c9e-7dc07d70e83a None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.250819 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac345e35-d9ac-4c80-9c9e-7dc07d70e83a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.251098 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac345e35-d9ac-4c80-9c9e-7dc07d70e83a None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.253290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 324/663] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:14:58.259199 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e510065-ebf0-4113-95f0-68b1479fe3dc None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.259481 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e510065-ebf0-4113-95f0-68b1479fe3dc None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.259755 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e510065-ebf0-4113-95f0-68b1479fe3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.282407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2e510065-ebf0-4113-95f0-68b1479fe3dc None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:14:58.283601 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2e510065-ebf0-4113-95f0-68b1479fe3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:14:58.293040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 340/664] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:14:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:14:58.318666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac345e35-d9ac-4c80-9c9e-7dc07d70e83a None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.333518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac345e35-d9ac-4c80-9c9e-7dc07d70e83a None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.337946 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9738e88-d0ef-4421-a84c-7b2536506db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.338844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9738e88-d0ef-4421-a84c-7b2536506db6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.339106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9738e88-d0ef-4421-a84c-7b2536506db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.339444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9738e88-d0ef-4421-a84c-7b2536506db6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.351386 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9738e88-d0ef-4421-a84c-7b2536506db6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:14:58.358282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-b9738e88-d0ef-4421-a84c-7b2536506db6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:14:58.360319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 325/665] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:14:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:58.366468 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e510065-ebf0-4113-95f0-68b1479fe3dc None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.376564 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e510065-ebf0-4113-95f0-68b1479fe3dc None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.381702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24ab1-8fc3-4b4f-be3d-b0444025e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.382437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24ab1-8fc3-4b4f-be3d-b0444025e9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.382786 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24ab1-8fc3-4b4f-be3d-b0444025e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.383128 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f24ab1-8fc3-4b4f-be3d-b0444025e9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.383948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24ab1-8fc3-4b4f-be3d-b0444025e9f9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:58.384419 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24ab1-8fc3-4b4f-be3d-b0444025e9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:58.386076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f24ab1-8fc3-4b4f-be3d-b0444025e9f9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.396176 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 341/666] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:14:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:14:58.401435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9738e88-d0ef-4421-a84c-7b2536506db6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.416444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9738e88-d0ef-4421-a84c-7b2536506db6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.421990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326b260-9992-4c49-aa9c-73a424bf40cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.424408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326b260-9992-4c49-aa9c-73a424bf40cc admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.424800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326b260-9992-4c49-aa9c-73a424bf40cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.425181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326b260-9992-4c49-aa9c-73a424bf40cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.446180 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326b260-9992-4c49-aa9c-73a424bf40cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:58.448060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326b260-9992-4c49-aa9c-73a424bf40cc admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.472125 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-1326b260-9992-4c49-aa9c-73a424bf40cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:58.473346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 326/667] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:14:58.479019 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24ab1-8fc3-4b4f-be3d-b0444025e9f9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.493171 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f24ab1-8fc3-4b4f-be3d-b0444025e9f9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.497534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eba3e-11ef-4d5a-86bc-c606b29f8829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.498179 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eba3e-11ef-4d5a-86bc-c606b29f8829 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.498457 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eba3e-11ef-4d5a-86bc-c606b29f8829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.498729 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70eba3e-11ef-4d5a-86bc-c606b29f8829 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.500051 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70eba3e-11ef-4d5a-86bc-c606b29f8829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:58.508446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70eba3e-11ef-4d5a-86bc-c606b29f8829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:58.510050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70eba3e-11ef-4d5a-86bc-c606b29f8829 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.523423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 342/668] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:58.528745 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326b260-9992-4c49-aa9c-73a424bf40cc admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.540966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326b260-9992-4c49-aa9c-73a424bf40cc admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.551644 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b837d6-472a-4667-bc2a-c523e6fb7db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.552479 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b837d6-472a-4667-bc2a-c523e6fb7db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.552755 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b837d6-472a-4667-bc2a-c523e6fb7db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.553022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b837d6-472a-4667-bc2a-c523e6fb7db2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.565393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b837d6-472a-4667-bc2a-c523e6fb7db2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:58.567469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b837d6-472a-4667-bc2a-c523e6fb7db2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.585455 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-74b837d6-472a-4667-bc2a-c523e6fb7db2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 09:14:58.591115 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 327/669] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:14:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:58.592506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eba3e-11ef-4d5a-86bc-c606b29f8829 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.602927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70eba3e-11ef-4d5a-86bc-c606b29f8829 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.607272 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252c47a-6e6e-47ce-b5ce-8edfa710c26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.607924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252c47a-6e6e-47ce-b5ce-8edfa710c26f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.608227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252c47a-6e6e-47ce-b5ce-8edfa710c26f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.609135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252c47a-6e6e-47ce-b5ce-8edfa710c26f admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.610143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252c47a-6e6e-47ce-b5ce-8edfa710c26f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:58.610447 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252c47a-6e6e-47ce-b5ce-8edfa710c26f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:58.612295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252c47a-6e6e-47ce-b5ce-8edfa710c26f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.634294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 343/670] 10.222.0.90 () {56 vars in 1156 bytes} [Wed Feb 16 09:14:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:58.635625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b837d6-472a-4667-bc2a-c523e6fb7db2 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.645762 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b837d6-472a-4667-bc2a-c523e6fb7db2 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.650206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d52d6-65bb-4294-94b4-aaa8c461cb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.650980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d52d6-65bb-4294-94b4-aaa8c461cb5a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.651255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d52d6-65bb-4294-94b4-aaa8c461cb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.651528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d52d6-65bb-4294-94b4-aaa8c461cb5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.663356 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d52d6-65bb-4294-94b4-aaa8c461cb5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:58.665328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d52d6-65bb-4294-94b4-aaa8c461cb5a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.683036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-d78d52d6-65bb-4294-94b4-aaa8c461cb5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:14:58.688149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 328/671] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:58.690140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252c47a-6e6e-47ce-b5ce-8edfa710c26f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.700071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252c47a-6e6e-47ce-b5ce-8edfa710c26f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.705103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf27e30-4aac-40a0-8470-de4e748739c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.705794 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf27e30-4aac-40a0-8470-de4e748739c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.706075 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf27e30-4aac-40a0-8470-de4e748739c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.706398 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf27e30-4aac-40a0-8470-de4e748739c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.707103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf27e30-4aac-40a0-8470-de4e748739c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:58.707450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf27e30-4aac-40a0-8470-de4e748739c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:58.709124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf27e30-4aac-40a0-8470-de4e748739c6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.725968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 344/672] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:58.727336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d52d6-65bb-4294-94b4-aaa8c461cb5a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.737465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d52d6-65bb-4294-94b4-aaa8c461cb5a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.742179 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973b87-b4c1-41eb-b8be-22166669dcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.742849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973b87-b4c1-41eb-b8be-22166669dcd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.743177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973b87-b4c1-41eb-b8be-22166669dcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.743454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973b87-b4c1-41eb-b8be-22166669dcd0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.750999 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae973b87-b4c1-41eb-b8be-22166669dcd0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:58.753008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae973b87-b4c1-41eb-b8be-22166669dcd0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.767522 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-ae973b87-b4c1-41eb-b8be-22166669dcd0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:14:58.771845 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 329/673] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:14:58.774733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf27e30-4aac-40a0-8470-de4e748739c6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.785399 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf27e30-4aac-40a0-8470-de4e748739c6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.789829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515380a-6e7e-4a8b-99aa-118bae2d4a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.790521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515380a-6e7e-4a8b-99aa-118bae2d4a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.790801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515380a-6e7e-4a8b-99aa-118bae2d4a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.791076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515380a-6e7e-4a8b-99aa-118bae2d4a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.791916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515380a-6e7e-4a8b-99aa-118bae2d4a84 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:14:58.792410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515380a-6e7e-4a8b-99aa-118bae2d4a84 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:58.794285 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515380a-6e7e-4a8b-99aa-118bae2d4a84 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.811770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 345/674] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:14:58.813244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973b87-b4c1-41eb-b8be-22166669dcd0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:14:58.822942 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973b87-b4c1-41eb-b8be-22166669dcd0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:14:58.828200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfeba8-002e-4f2d-9f62-566d2481ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:14:58.829210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfeba8-002e-4f2d-9f62-566d2481ed37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:14:58.829489 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfeba8-002e-4f2d-9f62-566d2481ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:14:58.829761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfeba8-002e-4f2d-9f62-566d2481ed37 admin admin] PATH_INFO: `/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/faf1f200fb2b4a2fb75b971054885eef/roles/068cd8712b8547b89967dd5d7964007b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:14:58.845320 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfeba8-002e-4f2d-9f62-566d2481ed37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ab51e6e2745658b252fbafdc2f8ef, user_id=faf1f200fb2b4a2fb75b971054885eef, role_id=068cd8712b8547b89967dd5d7964007b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:14:58.848040 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfeba8-002e-4f2d-9f62-566d2481ed37 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:14:58.868235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 330/675] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:14:58 2022] PUT /identity/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/faf1f200fb2b4a2fb75b971054885eef/roles/068cd8712b8547b89967dd5d7964007b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:15:00.054696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867856f-a79f-4b91-8056-7d3c556a4fa1 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.055379 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867856f-a79f-4b91-8056-7d3c556a4fa1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.055379 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867856f-a79f-4b91-8056-7d3c556a4fa1 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.057325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 346/676] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:00.069639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529369a-01c0-47b0-9a06-990c807e9215 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.070205 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529369a-01c0-47b0-9a06-990c807e9215 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.070205 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529369a-01c0-47b0-9a06-990c807e9215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.092522 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-2529369a-01c0-47b0-9a06-990c807e9215 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:00.093954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2529369a-01c0-47b0-9a06-990c807e9215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:00.173798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 331/677] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:15:00.210028 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867856f-a79f-4b91-8056-7d3c556a4fa1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:00.227071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867856f-a79f-4b91-8056-7d3c556a4fa1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:00.231335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ec8ce-d222-4387-8370-df8d0e6c099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:00.232128 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ec8ce-d222-4387-8370-df8d0e6c099b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.232407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ec8ce-d222-4387-8370-df8d0e6c099b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.232674 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ec8ce-d222-4387-8370-df8d0e6c099b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.248262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ec8ce-d222-4387-8370-df8d0e6c099b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:00.255644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-b07ec8ce-d222-4387-8370-df8d0e6c099b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:15:00.257296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 347/678] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:00.262939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529369a-01c0-47b0-9a06-990c807e9215 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:00.277090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529369a-01c0-47b0-9a06-990c807e9215 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:00.292674 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101369d-746b-444d-acab-678096131375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:00.293619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101369d-746b-444d-acab-678096131375 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.294247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101369d-746b-444d-acab-678096131375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.294739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101369d-746b-444d-acab-678096131375 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.295685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101369d-746b-444d-acab-678096131375 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:00.296861 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101369d-746b-444d-acab-678096131375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:00.298983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101369d-746b-444d-acab-678096131375 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:00.308239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 332/679] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:15:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:00.314977 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ec8ce-d222-4387-8370-df8d0e6c099b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:00.324937 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ec8ce-d222-4387-8370-df8d0e6c099b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:00.334501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9105ef-1447-4045-9ab8-0683ee94e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:00.335288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9105ef-1447-4045-9ab8-0683ee94e564 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.335567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9105ef-1447-4045-9ab8-0683ee94e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.335841 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9105ef-1447-4045-9ab8-0683ee94e564 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.348955 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9105ef-1447-4045-9ab8-0683ee94e564 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:00.350860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9105ef-1447-4045-9ab8-0683ee94e564 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:00.368294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-0a9105ef-1447-4045-9ab8-0683ee94e564 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:00.369847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 348/680] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:00.375899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101369d-746b-444d-acab-678096131375 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:00.393934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101369d-746b-444d-acab-678096131375 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:00.404648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0aaf4-7428-461b-9a81-c529b9eaddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:00.406370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0aaf4-7428-461b-9a81-c529b9eaddbe admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.406875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0aaf4-7428-461b-9a81-c529b9eaddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.407354 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0aaf4-7428-461b-9a81-c529b9eaddbe admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.408364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0aaf4-7428-461b-9a81-c529b9eaddbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:00.408907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0aaf4-7428-461b-9a81-c529b9eaddbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:00.410772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0aaf4-7428-461b-9a81-c529b9eaddbe admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:00.434513 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 333/681] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:00.441069 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9105ef-1447-4045-9ab8-0683ee94e564 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:00.457143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9105ef-1447-4045-9ab8-0683ee94e564 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:00.464175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72a0eb-7118-4163-87e2-e25eda12f053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:00.464962 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72a0eb-7118-4163-87e2-e25eda12f053 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.465245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72a0eb-7118-4163-87e2-e25eda12f053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.465520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72a0eb-7118-4163-87e2-e25eda12f053 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.485417 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72a0eb-7118-4163-87e2-e25eda12f053 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:00.487500 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72a0eb-7118-4163-87e2-e25eda12f053 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:00.507573 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-0b72a0eb-7118-4163-87e2-e25eda12f053 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 09:15:00.516286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 349/682] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Feb 16 09:15:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:00.517627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0aaf4-7428-461b-9a81-c529b9eaddbe admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:00.534452 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0aaf4-7428-461b-9a81-c529b9eaddbe admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:00.547979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfece20-ae66-40ba-8b3c-0d853045282c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:00.548939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfece20-ae66-40ba-8b3c-0d853045282c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.549419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfece20-ae66-40ba-8b3c-0d853045282c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.549888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfece20-ae66-40ba-8b3c-0d853045282c admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.550912 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfece20-ae66-40ba-8b3c-0d853045282c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:00.551433 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfece20-ae66-40ba-8b3c-0d853045282c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:00.553540 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfece20-ae66-40ba-8b3c-0d853045282c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:00.590337 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 334/683] 10.222.0.90 () {56 vars in 1154 bytes} [Wed Feb 16 09:15:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:00.596465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72a0eb-7118-4163-87e2-e25eda12f053 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:00.606644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72a0eb-7118-4163-87e2-e25eda12f053 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:00.611751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06b2e3-7394-458b-b6c5-e6a55135e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:00.612415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06b2e3-7394-458b-b6c5-e6a55135e772 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.612694 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06b2e3-7394-458b-b6c5-e6a55135e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.612970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06b2e3-7394-458b-b6c5-e6a55135e772 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.621095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06b2e3-7394-458b-b6c5-e6a55135e772 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:00.622846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06b2e3-7394-458b-b6c5-e6a55135e772 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:00.632735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 350/684] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:15:00.638319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfece20-ae66-40ba-8b3c-0d853045282c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:00.648987 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfece20-ae66-40ba-8b3c-0d853045282c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:00.653538 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95739cf-0323-4647-8703-315675a67a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:00.654318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95739cf-0323-4647-8703-315675a67a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.654603 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95739cf-0323-4647-8703-315675a67a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.654879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95739cf-0323-4647-8703-315675a67a5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.665702 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95739cf-0323-4647-8703-315675a67a5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:00.667593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95739cf-0323-4647-8703-315675a67a5b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:00.684808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-f95739cf-0323-4647-8703-315675a67a5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:00.686321 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 335/685] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:00.692361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06b2e3-7394-458b-b6c5-e6a55135e772 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:00.701276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06b2e3-7394-458b-b6c5-e6a55135e772 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:00.706609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b14c25-ba60-4db9-a98a-d94febcfdb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:00.707253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b14c25-ba60-4db9-a98a-d94febcfdb33 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.707535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b14c25-ba60-4db9-a98a-d94febcfdb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.707811 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b14c25-ba60-4db9-a98a-d94febcfdb33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.708565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b14c25-ba60-4db9-a98a-d94febcfdb33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:00.708874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b14c25-ba60-4db9-a98a-d94febcfdb33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:00.710555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b14c25-ba60-4db9-a98a-d94febcfdb33 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:00.723732 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 351/686] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:00.729162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95739cf-0323-4647-8703-315675a67a5b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:00.741986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95739cf-0323-4647-8703-315675a67a5b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:00.748399 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fd98a-c1dd-4f2c-90d7-19c5fa5e60a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:00.749313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fd98a-c1dd-4f2c-90d7-19c5fa5e60a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.749595 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fd98a-c1dd-4f2c-90d7-19c5fa5e60a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.749881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fd98a-c1dd-4f2c-90d7-19c5fa5e60a1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.761286 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fd98a-c1dd-4f2c-90d7-19c5fa5e60a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:00.763832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fd98a-c1dd-4f2c-90d7-19c5fa5e60a1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:00.788815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-bd5fd98a-c1dd-4f2c-90d7-19c5fa5e60a1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:00.790659 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 336/687] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:00.796977 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b14c25-ba60-4db9-a98a-d94febcfdb33 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:00.814226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b14c25-ba60-4db9-a98a-d94febcfdb33 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:00.821632 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da977c-75d1-4047-86e1-caa4eaa780d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:00.822344 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da977c-75d1-4047-86e1-caa4eaa780d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.822629 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da977c-75d1-4047-86e1-caa4eaa780d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.822964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da977c-75d1-4047-86e1-caa4eaa780d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.823794 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da977c-75d1-4047-86e1-caa4eaa780d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:00.824129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da977c-75d1-4047-86e1-caa4eaa780d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:00.826080 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da977c-75d1-4047-86e1-caa4eaa780d7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:00.846191 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 352/688] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:00.852249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fd98a-c1dd-4f2c-90d7-19c5fa5e60a1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:00.868405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fd98a-c1dd-4f2c-90d7-19c5fa5e60a1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:00.880684 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae00be-eb09-4a3c-bd83-e5ff676e0831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:00.881663 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae00be-eb09-4a3c-bd83-e5ff676e0831 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.882165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae00be-eb09-4a3c-bd83-e5ff676e0831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.882640 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae00be-eb09-4a3c-bd83-e5ff676e0831 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.883660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae00be-eb09-4a3c-bd83-e5ff676e0831 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=9801d0694ec54d65bdd5b8914e05637e) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:00.884210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae00be-eb09-4a3c-bd83-e5ff676e0831 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:00.886257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae00be-eb09-4a3c-bd83-e5ff676e0831 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:00.893566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 337/689] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:00 2022] GET /identity/v3/role_assignments?user.id=9801d0694ec54d65bdd5b8914e05637e&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=0e45946c6336419abb2015d8916e31ca => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:00.922121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8032dd8-987c-482d-a2e1-d0ad2a31cc79 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.922416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8032dd8-987c-482d-a2e1-d0ad2a31cc79 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.922696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8032dd8-987c-482d-a2e1-d0ad2a31cc79 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.924844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 353/690] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:00.931108 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05fc85-7761-4626-a173-941413ba16bc None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:00.931439 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05fc85-7761-4626-a173-941413ba16bc None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:00.931665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05fc85-7761-4626-a173-941413ba16bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:00.960430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-ee05fc85-7761-4626-a173-941413ba16bc None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:00.961639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ee05fc85-7761-4626-a173-941413ba16bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:00.976874 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 338/691] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:15:01.017595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8032dd8-987c-482d-a2e1-d0ad2a31cc79 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:01.031964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8032dd8-987c-482d-a2e1-d0ad2a31cc79 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:01.039443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226441d-ee63-40ab-9867-91fe76ff43e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:01.040320 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226441d-ee63-40ab-9867-91fe76ff43e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.040602 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226441d-ee63-40ab-9867-91fe76ff43e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.040879 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226441d-ee63-40ab-9867-91fe76ff43e1 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.041599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226441d-ee63-40ab-9867-91fe76ff43e1 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:01.042684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-2226441d-ee63-40ab-9867-91fe76ff43e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:15:01.042684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:15:01.042684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:15:01.043680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226441d-ee63-40ab-9867-91fe76ff43e1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:01.058839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-2226441d-ee63-40ab-9867-91fe76ff43e1 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 16 09:15:01.060460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 354/692] 10.222.0.90 () {56 vars in 1150 bytes} [Wed Feb 16 09:15:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:01.066957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05fc85-7761-4626-a173-941413ba16bc None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:01.076552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05fc85-7761-4626-a173-941413ba16bc None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:01.081916 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b2dd6-61fb-4b59-981e-5e9ac70e3365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:01.082608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b2dd6-61fb-4b59-981e-5e9ac70e3365 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.082889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b2dd6-61fb-4b59-981e-5e9ac70e3365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.083166 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b2dd6-61fb-4b59-981e-5e9ac70e3365 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.083891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b2dd6-61fb-4b59-981e-5e9ac70e3365 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:01.084237 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b2dd6-61fb-4b59-981e-5e9ac70e3365 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:01.085391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-b16b2dd6-61fb-4b59-981e-5e9ac70e3365 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:15:01.085391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:15:01.085391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:15:01.086290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b2dd6-61fb-4b59-981e-5e9ac70e3365 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:01.091813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 339/693] 10.222.0.90 () {56 vars in 1145 bytes} [Wed Feb 16 09:15:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:01.098275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226441d-ee63-40ab-9867-91fe76ff43e1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:01.110095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226441d-ee63-40ab-9867-91fe76ff43e1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:01.114865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd5c11-7ffa-4017-a547-9fa08f38e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:01.115570 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd5c11-7ffa-4017-a547-9fa08f38e834 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.115860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd5c11-7ffa-4017-a547-9fa08f38e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.116172 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd5c11-7ffa-4017-a547-9fa08f38e834 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.116943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd5c11-7ffa-4017-a547-9fa08f38e834 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:01.117252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd5c11-7ffa-4017-a547-9fa08f38e834 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:01.118323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-fcdd5c11-7ffa-4017-a547-9fa08f38e834 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:15:01.118323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:15:01.118323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:15:01.119266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd5c11-7ffa-4017-a547-9fa08f38e834 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:01.126635 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 355/694] 10.222.0.90 () {56 vars in 1145 bytes} [Wed Feb 16 09:15:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:01.240988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853b3b3-a057-4fc7-bfb4-000c9f1e4f7d None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.241366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853b3b3-a057-4fc7-bfb4-000c9f1e4f7d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.241527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853b3b3-a057-4fc7-bfb4-000c9f1e4f7d None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.243625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 340/695] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:01.250106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486a3d9-19f9-4537-ad09-0b792ff9863a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.250392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486a3d9-19f9-4537-ad09-0b792ff9863a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.250661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486a3d9-19f9-4537-ad09-0b792ff9863a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.281888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3486a3d9-19f9-4537-ad09-0b792ff9863a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:01.283136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3486a3d9-19f9-4537-ad09-0b792ff9863a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:01.294823 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 356/696] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:15:01.341612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853b3b3-a057-4fc7-bfb4-000c9f1e4f7d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:01.357956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853b3b3-a057-4fc7-bfb4-000c9f1e4f7d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:01.364622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aad3f-c9c6-48df-a996-64b05d694f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:01.365408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aad3f-c9c6-48df-a996-64b05d694f7d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.365744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aad3f-c9c6-48df-a996-64b05d694f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.366021 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aad3f-c9c6-48df-a996-64b05d694f7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.378366 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645993ad-ebf5-42b3-8ea8-3fa509cc121f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.378657 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645993ad-ebf5-42b3-8ea8-3fa509cc121f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.378924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645993ad-ebf5-42b3-8ea8-3fa509cc121f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.380756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 357/697] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:15:01.384106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aad3f-c9c6-48df-a996-64b05d694f7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:01.386012 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d67a7b-6fee-4ee4-84ce-9712c4b3e339 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.386301 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d67a7b-6fee-4ee4-84ce-9712c4b3e339 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.386577 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d67a7b-6fee-4ee4-84ce-9712c4b3e339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.392498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aad3f-c9c6-48df-a996-64b05d694f7d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:01.414165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-e25aad3f-c9c6-48df-a996-64b05d694f7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:01.414468 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c7d67a7b-6fee-4ee4-84ce-9712c4b3e339 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:01.415527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c7d67a7b-6fee-4ee4-84ce-9712c4b3e339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:01.415793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 341/698] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:01.421931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aad3f-c9c6-48df-a996-64b05d694f7d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:01.424725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 358/699] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:15:01.433328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aad3f-c9c6-48df-a996-64b05d694f7d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:01.438805 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6dbec-0a2e-446d-acdb-2ec5e1bafa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:01.439586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6dbec-0a2e-446d-acdb-2ec5e1bafa4b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.439870 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6dbec-0a2e-446d-acdb-2ec5e1bafa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.440179 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6dbec-0a2e-446d-acdb-2ec5e1bafa4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.440969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6dbec-0a2e-446d-acdb-2ec5e1bafa4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:01.441275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6dbec-0a2e-446d-acdb-2ec5e1bafa4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:01.443018 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6dbec-0a2e-446d-acdb-2ec5e1bafa4b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:01.448900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d67a7b-6fee-4ee4-84ce-9712c4b3e339 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:01.457749 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 342/700] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:01.458970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d67a7b-6fee-4ee4-84ce-9712c4b3e339 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:01.463134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6dbec-0a2e-446d-acdb-2ec5e1bafa4b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:01.463651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef9382-fe9d-4103-b4a7-ab64c08d6c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:01.464649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef9382-fe9d-4103-b4a7-ab64c08d6c5e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.464932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef9382-fe9d-4103-b4a7-ab64c08d6c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.465205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef9382-fe9d-4103-b4a7-ab64c08d6c5e admin admin] PATH_INFO: `/v3/services/network` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.465856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef9382-fe9d-4103-b4a7-ab64c08d6c5e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:01.467441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef9382-fe9d-4103-b4a7-ab64c08d6c5e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:01.474532 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6dbec-0a2e-446d-acdb-2ec5e1bafa4b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:01.479247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c56f1c-d634-442b-a46d-4d78ffeeba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:01.479455 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-dbef9382-fe9d-4103-b4a7-ab64c08d6c5e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 16 09:15:01.479950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c56f1c-d634-442b-a46d-4d78ffeeba56 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.480273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c56f1c-d634-442b-a46d-4d78ffeeba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.480554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c56f1c-d634-442b-a46d-4d78ffeeba56 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.480872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 359/701] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:01 2022] GET /identity/v3/services/network => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:01.481358 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c56f1c-d634-442b-a46d-4d78ffeeba56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:01.483428 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c56f1c-d634-442b-a46d-4d78ffeeba56 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:01.487353 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef9382-fe9d-4103-b4a7-ab64c08d6c5e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:01.497039 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef9382-fe9d-4103-b4a7-ab64c08d6c5e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:01.503538 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c8724-4fb2-4f1d-b3c5-1782afc533dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:01.504358 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c8724-4fb2-4f1d-b3c5-1782afc533dd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.504691 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c8724-4fb2-4f1d-b3c5-1782afc533dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.505060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c8724-4fb2-4f1d-b3c5-1782afc533dd admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.505761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c8724-4fb2-4f1d-b3c5-1782afc533dd admin admin] RBAC: Adding query filter params (name=network) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:01.506169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c8724-4fb2-4f1d-b3c5-1782afc533dd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:01.507997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c8724-4fb2-4f1d-b3c5-1782afc533dd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:01.513164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 360/702] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:01.520112 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c8724-4fb2-4f1d-b3c5-1782afc533dd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:01.523677 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 343/703] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:15:01 2022] POST /identity/v3/users => generated 254 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:15:01.532522 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c8724-4fb2-4f1d-b3c5-1782afc533dd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:01.538111 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41b6ee-a427-4f07-8c10-bbccaf0d0b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:01.539371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b6ee-a427-4f07-8c10-bbccaf0d0b57 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.539869 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b6ee-a427-4f07-8c10-bbccaf0d0b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.540456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b6ee-a427-4f07-8c10-bbccaf0d0b57 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.542063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41b6ee-a427-4f07-8c10-bbccaf0d0b57 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:01.542685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41b6ee-a427-4f07-8c10-bbccaf0d0b57 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:01.546867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41b6ee-a427-4f07-8c10-bbccaf0d0b57 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:01.556773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 361/704] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:01.857708 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490fad5-f79e-4407-a29d-a8ee33d0ac1d None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.858171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490fad5-f79e-4407-a29d-a8ee33d0ac1d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.858481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490fad5-f79e-4407-a29d-a8ee33d0ac1d None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.860965 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 344/705] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:01.866579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6558-eccb-49ad-b5d5-589df6788a85 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.866864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6558-eccb-49ad-b5d5-589df6788a85 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.867136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d6558-eccb-49ad-b5d5-589df6788a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.886592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5d7d6558-eccb-49ad-b5d5-589df6788a85 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:01.887773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5d7d6558-eccb-49ad-b5d5-589df6788a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:01.897665 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 362/706] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:15:01.923242 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490fad5-f79e-4407-a29d-a8ee33d0ac1d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:01.935481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490fad5-f79e-4407-a29d-a8ee33d0ac1d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:01.940872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e703a2-b090-43af-8f45-ac0d5137b81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:01.941733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e703a2-b090-43af-8f45-ac0d5137b81f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.942086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e703a2-b090-43af-8f45-ac0d5137b81f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.942427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e703a2-b090-43af-8f45-ac0d5137b81f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.956245 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e703a2-b090-43af-8f45-ac0d5137b81f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:01.963286 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-92e703a2-b090-43af-8f45-ac0d5137b81f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:15:01.964979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 345/707] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:15:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:01.971789 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d6558-eccb-49ad-b5d5-589df6788a85 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:01.981060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d6558-eccb-49ad-b5d5-589df6788a85 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:01.987675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42479a-ac73-4901-8cb3-b949d9adce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:01.988453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42479a-ac73-4901-8cb3-b949d9adce60 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:01.988805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42479a-ac73-4901-8cb3-b949d9adce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:01.989148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42479a-ac73-4901-8cb3-b949d9adce60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:01.989968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42479a-ac73-4901-8cb3-b949d9adce60 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:01.990342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42479a-ac73-4901-8cb3-b949d9adce60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:01.991991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42479a-ac73-4901-8cb3-b949d9adce60 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:02.001496 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 363/708] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:15:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:02.006980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e703a2-b090-43af-8f45-ac0d5137b81f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:02.019432 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e703a2-b090-43af-8f45-ac0d5137b81f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:02.024407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c8d47-ed22-44b3-8042-063c4f6d29f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:02.025204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c8d47-ed22-44b3-8042-063c4f6d29f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:02.025486 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c8d47-ed22-44b3-8042-063c4f6d29f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:02.025760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c8d47-ed22-44b3-8042-063c4f6d29f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:02.041414 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c8d47-ed22-44b3-8042-063c4f6d29f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:02.043330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c8d47-ed22-44b3-8042-063c4f6d29f3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:02.061412 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-757c8d47-ed22-44b3-8042-063c4f6d29f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:02.063604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 346/709] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:02.068788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42479a-ac73-4901-8cb3-b949d9adce60 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:02.078995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42479a-ac73-4901-8cb3-b949d9adce60 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:02.085575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9544921-969d-45a3-a57b-07187a0ee75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:02.086292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9544921-969d-45a3-a57b-07187a0ee75b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:02.086574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9544921-969d-45a3-a57b-07187a0ee75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:02.086855 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9544921-969d-45a3-a57b-07187a0ee75b admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:02.087636 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9544921-969d-45a3-a57b-07187a0ee75b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:02.087947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9544921-969d-45a3-a57b-07187a0ee75b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:02.089735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9544921-969d-45a3-a57b-07187a0ee75b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:02.103436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 364/710] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:02.109137 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c8d47-ed22-44b3-8042-063c4f6d29f3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:02.119380 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c8d47-ed22-44b3-8042-063c4f6d29f3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:02.124326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5309c5e-224a-4b5a-9502-565450723388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:02.125340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5309c5e-224a-4b5a-9502-565450723388 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:02.125625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5309c5e-224a-4b5a-9502-565450723388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:02.125903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5309c5e-224a-4b5a-9502-565450723388 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:02.133972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5309c5e-224a-4b5a-9502-565450723388 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:02.136157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5309c5e-224a-4b5a-9502-565450723388 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:02.152389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-c5309c5e-224a-4b5a-9502-565450723388 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 09:15:02.153861 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 347/711] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:02.160278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9544921-969d-45a3-a57b-07187a0ee75b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:02.170479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9544921-969d-45a3-a57b-07187a0ee75b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:02.177151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004e84-ba6e-4e92-88a4-e5ae34b9c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:02.177865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004e84-ba6e-4e92-88a4-e5ae34b9c1eb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:02.178145 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004e84-ba6e-4e92-88a4-e5ae34b9c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:02.178417 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed004e84-ba6e-4e92-88a4-e5ae34b9c1eb admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:02.179311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004e84-ba6e-4e92-88a4-e5ae34b9c1eb admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:02.179622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004e84-ba6e-4e92-88a4-e5ae34b9c1eb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:02.181567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed004e84-ba6e-4e92-88a4-e5ae34b9c1eb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:02.203833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 365/712] 10.222.0.90 () {56 vars in 1156 bytes} [Wed Feb 16 09:15:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:02.209252 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5309c5e-224a-4b5a-9502-565450723388 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:02.220471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5309c5e-224a-4b5a-9502-565450723388 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:02.225434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed33e4c-bb79-4de7-b787-fc2982f9da3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:02.226086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33e4c-bb79-4de7-b787-fc2982f9da3d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:02.226401 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33e4c-bb79-4de7-b787-fc2982f9da3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:02.226774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33e4c-bb79-4de7-b787-fc2982f9da3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:02.236682 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed33e4c-bb79-4de7-b787-fc2982f9da3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:02.238571 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed33e4c-bb79-4de7-b787-fc2982f9da3d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:02.253438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 348/713] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:15:02.258563 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004e84-ba6e-4e92-88a4-e5ae34b9c1eb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:02.272462 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed004e84-ba6e-4e92-88a4-e5ae34b9c1eb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:02.277079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9688e-ef43-493c-b73d-2d5ac705c712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:02.277905 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9688e-ef43-493c-b73d-2d5ac705c712 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:02.278187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9688e-ef43-493c-b73d-2d5ac705c712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:02.278553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9688e-ef43-493c-b73d-2d5ac705c712 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:02.289518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9688e-ef43-493c-b73d-2d5ac705c712 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:02.291332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9688e-ef43-493c-b73d-2d5ac705c712 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:02.308608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-d9e9688e-ef43-493c-b73d-2d5ac705c712 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:02.310101 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 366/714] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:02.316515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed33e4c-bb79-4de7-b787-fc2982f9da3d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:02.325472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed33e4c-bb79-4de7-b787-fc2982f9da3d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:02.338262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cd086-9900-4bab-8ef5-b758204a094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:02.338932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cd086-9900-4bab-8ef5-b758204a094f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:02.339210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cd086-9900-4bab-8ef5-b758204a094f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:02.339482 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cd086-9900-4bab-8ef5-b758204a094f admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:02.340251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cd086-9900-4bab-8ef5-b758204a094f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:02.343390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cd086-9900-4bab-8ef5-b758204a094f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:02.343390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060cd086-9900-4bab-8ef5-b758204a094f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:02.360673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 349/715] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:02.366266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9688e-ef43-493c-b73d-2d5ac705c712 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:02.381089 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9688e-ef43-493c-b73d-2d5ac705c712 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:02.389808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e865c-20f2-4f6c-90d0-b96572efd8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:02.389808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e865c-20f2-4f6c-90d0-b96572efd8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:02.389808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e865c-20f2-4f6c-90d0-b96572efd8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:02.389808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e865c-20f2-4f6c-90d0-b96572efd8a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:02.400865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e865c-20f2-4f6c-90d0-b96572efd8a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:02.402837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e865c-20f2-4f6c-90d0-b96572efd8a2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:02.421090 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e11e865c-20f2-4f6c-90d0-b96572efd8a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:02.423631 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 367/716] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:02.428996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cd086-9900-4bab-8ef5-b758204a094f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:02.442389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cd086-9900-4bab-8ef5-b758204a094f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:02.453177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6402198-2a41-46d2-8e32-9a80fb29d1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:02.453866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402198-2a41-46d2-8e32-9a80fb29d1ef admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:02.454148 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402198-2a41-46d2-8e32-9a80fb29d1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:02.454422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402198-2a41-46d2-8e32-9a80fb29d1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:02.455220 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6402198-2a41-46d2-8e32-9a80fb29d1ef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:02.455524 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6402198-2a41-46d2-8e32-9a80fb29d1ef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:02.457411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6402198-2a41-46d2-8e32-9a80fb29d1ef admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:02.479265 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 350/717] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:02.485349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e865c-20f2-4f6c-90d0-b96572efd8a2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:02.498370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e865c-20f2-4f6c-90d0-b96572efd8a2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:02.507928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e53019-aba7-4fa1-a793-ab632d03745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:02.508604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e53019-aba7-4fa1-a793-ab632d03745f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:02.508885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e53019-aba7-4fa1-a793-ab632d03745f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:02.509163 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e53019-aba7-4fa1-a793-ab632d03745f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:02.509993 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e53019-aba7-4fa1-a793-ab632d03745f admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=faf1f200fb2b4a2fb75b971054885eef) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:02.510301 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e53019-aba7-4fa1-a793-ab632d03745f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:02.512172 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e53019-aba7-4fa1-a793-ab632d03745f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:02.520344 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 368/718] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:02 2022] GET /identity/v3/role_assignments?user.id=faf1f200fb2b4a2fb75b971054885eef&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:03.795527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801c3c-2ca8-4fe8-bbba-3427fef6ef37 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:03.796302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801c3c-2ca8-4fe8-bbba-3427fef6ef37 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:03.796302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73801c3c-2ca8-4fe8-bbba-3427fef6ef37 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:03.798372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 351/719] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:03.804036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99618a0-032c-452d-83b9-b9b499c8d89d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:03.804596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99618a0-032c-452d-83b9-b9b499c8d89d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:03.804596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99618a0-032c-452d-83b9-b9b499c8d89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:03.829021 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c99618a0-032c-452d-83b9-b9b499c8d89d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:03.830221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c99618a0-032c-452d-83b9-b9b499c8d89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:03.838344 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 369/720] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:15:03.860686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356c893-3829-441b-9a20-143743fc336c None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:03.860986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356c893-3829-441b-9a20-143743fc336c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:03.861224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356c893-3829-441b-9a20-143743fc336c None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:03.863220 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 352/721] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:03.868825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36671712-0965-480a-9efa-a237d1acf171 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:03.869116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36671712-0965-480a-9efa-a237d1acf171 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:03.869393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36671712-0965-480a-9efa-a237d1acf171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:03.872362 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356c893-3829-441b-9a20-143743fc336c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:03.894552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356c893-3829-441b-9a20-143743fc336c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:03.895232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-36671712-0965-480a-9efa-a237d1acf171 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:03.896457 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-36671712-0965-480a-9efa-a237d1acf171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:03.898925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6b7d2-3b3f-495c-8eab-8839f1131873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:03.899571 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6b7d2-3b3f-495c-8eab-8839f1131873 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:03.899851 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6b7d2-3b3f-495c-8eab-8839f1131873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:03.900162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6b7d2-3b3f-495c-8eab-8839f1131873 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:03.900872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6b7d2-3b3f-495c-8eab-8839f1131873 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:03.901877 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-47a6b7d2-3b3f-495c-8eab-8839f1131873 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:15:03.901877 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:15:03.901877 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:15:03.902758 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6b7d2-3b3f-495c-8eab-8839f1131873 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:03.910512 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 370/722] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 09:15:03.924768 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 353/723] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:15:03 2022] POST /identity/v3/services => generated 251 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:15:03.955093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36671712-0965-480a-9efa-a237d1acf171 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:03.964816 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36671712-0965-480a-9efa-a237d1acf171 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.004476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8673b89-cd6a-40a4-b274-a080c35a1c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.005408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8673b89-cd6a-40a4-b274-a080c35a1c3b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.005693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8673b89-cd6a-40a4-b274-a080c35a1c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.005974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8673b89-cd6a-40a4-b274-a080c35a1c3b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.030187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8673b89-cd6a-40a4-b274-a080c35a1c3b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:04.038118 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e8673b89-cd6a-40a4-b274-a080c35a1c3b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:15:04.039738 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 371/724] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:04.045645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6b7d2-3b3f-495c-8eab-8839f1131873 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.063979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6b7d2-3b3f-495c-8eab-8839f1131873 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.081073 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb80834-1320-41aa-a514-f923ca652d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.081775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb80834-1320-41aa-a514-f923ca652d79 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.082061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb80834-1320-41aa-a514-f923ca652d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.082402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb80834-1320-41aa-a514-f923ca652d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.083169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb80834-1320-41aa-a514-f923ca652d79 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:04.083522 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb80834-1320-41aa-a514-f923ca652d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.085197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb80834-1320-41aa-a514-f923ca652d79 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:04.094982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 354/725] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:15:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:04.101271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8673b89-cd6a-40a4-b274-a080c35a1c3b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.115312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8673b89-cd6a-40a4-b274-a080c35a1c3b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.134105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53a07a-46ae-4367-b814-d7ba1854b19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.134636 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53a07a-46ae-4367-b814-d7ba1854b19d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.134916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53a07a-46ae-4367-b814-d7ba1854b19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.135189 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53a07a-46ae-4367-b814-d7ba1854b19d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.148746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53a07a-46ae-4367-b814-d7ba1854b19d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.150610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53a07a-46ae-4367-b814-d7ba1854b19d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:04.169718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-4e53a07a-46ae-4367-b814-d7ba1854b19d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:04.171815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 372/726] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:04.177607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb80834-1320-41aa-a514-f923ca652d79 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.190193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb80834-1320-41aa-a514-f923ca652d79 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.194908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc04e9a-73f7-4bfe-b19c-484ca34764aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.195561 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc04e9a-73f7-4bfe-b19c-484ca34764aa admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.195935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc04e9a-73f7-4bfe-b19c-484ca34764aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.196251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc04e9a-73f7-4bfe-b19c-484ca34764aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.197012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc04e9a-73f7-4bfe-b19c-484ca34764aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:04.197319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc04e9a-73f7-4bfe-b19c-484ca34764aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.198973 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc04e9a-73f7-4bfe-b19c-484ca34764aa admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:04.213964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 355/727] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:04.220438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53a07a-46ae-4367-b814-d7ba1854b19d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.232818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53a07a-46ae-4367-b814-d7ba1854b19d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.240400 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f0f13-a405-4484-9633-847cc5bcb82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.241207 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f0f13-a405-4484-9633-847cc5bcb82e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.241488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f0f13-a405-4484-9633-847cc5bcb82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.241765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f0f13-a405-4484-9633-847cc5bcb82e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.250736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f0f13-a405-4484-9633-847cc5bcb82e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.252843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f0f13-a405-4484-9633-847cc5bcb82e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:04.267555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-b73f0f13-a405-4484-9633-847cc5bcb82e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 09:15:04.269022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 373/728] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Feb 16 09:15:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:04.274903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc04e9a-73f7-4bfe-b19c-484ca34764aa admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.290069 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc04e9a-73f7-4bfe-b19c-484ca34764aa admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.295218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7233edc-d7cb-4cd4-abf1-5fa9635e8026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.296546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7233edc-d7cb-4cd4-abf1-5fa9635e8026 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.296897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7233edc-d7cb-4cd4-abf1-5fa9635e8026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.297174 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7233edc-d7cb-4cd4-abf1-5fa9635e8026 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.298156 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7233edc-d7cb-4cd4-abf1-5fa9635e8026 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:04.298466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7233edc-d7cb-4cd4-abf1-5fa9635e8026 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.300450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7233edc-d7cb-4cd4-abf1-5fa9635e8026 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:04.320268 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 356/729] 10.222.0.90 () {56 vars in 1154 bytes} [Wed Feb 16 09:15:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:04.325851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f0f13-a405-4484-9633-847cc5bcb82e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.337904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f0f13-a405-4484-9633-847cc5bcb82e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.349812 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812a2d2-4d0f-49c6-86ea-eeb932d0bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.350610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812a2d2-4d0f-49c6-86ea-eeb932d0bc4a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.350889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812a2d2-4d0f-49c6-86ea-eeb932d0bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.351161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812a2d2-4d0f-49c6-86ea-eeb932d0bc4a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.369242 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812a2d2-4d0f-49c6-86ea-eeb932d0bc4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.371105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812a2d2-4d0f-49c6-86ea-eeb932d0bc4a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:04.393653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-2812a2d2-4d0f-49c6-86ea-eeb932d0bc4a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:04.395346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 374/730] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:04.400722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7233edc-d7cb-4cd4-abf1-5fa9635e8026 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.414232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7233edc-d7cb-4cd4-abf1-5fa9635e8026 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.418921 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70f7b2-9402-474d-aea0-3f0b61b60924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.419576 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70f7b2-9402-474d-aea0-3f0b61b60924 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.419906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70f7b2-9402-474d-aea0-3f0b61b60924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.420214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70f7b2-9402-474d-aea0-3f0b61b60924 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.422036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70f7b2-9402-474d-aea0-3f0b61b60924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:04.422351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70f7b2-9402-474d-aea0-3f0b61b60924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.424017 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70f7b2-9402-474d-aea0-3f0b61b60924 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:04.436956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 357/731] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:04.445336 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812a2d2-4d0f-49c6-86ea-eeb932d0bc4a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.460980 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812a2d2-4d0f-49c6-86ea-eeb932d0bc4a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.465759 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784d4a2-22f3-4a15-92b3-bdf984cc173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.466606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784d4a2-22f3-4a15-92b3-bdf984cc173f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.466889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784d4a2-22f3-4a15-92b3-bdf984cc173f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.467165 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784d4a2-22f3-4a15-92b3-bdf984cc173f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.476075 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784d4a2-22f3-4a15-92b3-bdf984cc173f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.478110 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784d4a2-22f3-4a15-92b3-bdf984cc173f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:04.493245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-1784d4a2-22f3-4a15-92b3-bdf984cc173f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:04.494906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 375/732] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:04.501065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70f7b2-9402-474d-aea0-3f0b61b60924 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.513553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70f7b2-9402-474d-aea0-3f0b61b60924 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.528708 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f72787-9b17-47fc-b370-23f9323ac9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.529773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f72787-9b17-47fc-b370-23f9323ac9ab admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.530366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f72787-9b17-47fc-b370-23f9323ac9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.530844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f72787-9b17-47fc-b370-23f9323ac9ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.531842 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f72787-9b17-47fc-b370-23f9323ac9ab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:04.532369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f72787-9b17-47fc-b370-23f9323ac9ab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.534459 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f72787-9b17-47fc-b370-23f9323ac9ab admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:04.535001 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feaa17-57eb-4292-bf95-5307ddb5fd1a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.535336 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feaa17-57eb-4292-bf95-5307ddb5fd1a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.535617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feaa17-57eb-4292-bf95-5307ddb5fd1a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.537699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 376/733] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:15:04.542651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ab8f-12bf-4007-8e7f-863312c7ea7d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.542933 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ab8f-12bf-4007-8e7f-863312c7ea7d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.543258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574ab8f-12bf-4007-8e7f-863312c7ea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.551339 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 358/734] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:04.556714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f72787-9b17-47fc-b370-23f9323ac9ab admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.565114 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6574ab8f-12bf-4007-8e7f-863312c7ea7d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:04.566295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6574ab8f-12bf-4007-8e7f-863312c7ea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:04.567846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f72787-9b17-47fc-b370-23f9323ac9ab admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.579157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac34105-41ff-4cfa-951a-6a547b644b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.580359 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac34105-41ff-4cfa-951a-6a547b644b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.580841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac34105-41ff-4cfa-951a-6a547b644b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.581326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac34105-41ff-4cfa-951a-6a547b644b32 admin admin] PATH_INFO: `/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/9801d0694ec54d65bdd5b8914e05637e/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.585555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac34105-41ff-4cfa-951a-6a547b644b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ab51e6e2745658b252fbafdc2f8ef, user_id=9801d0694ec54d65bdd5b8914e05637e, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.585778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 377/735] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:04 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:04.588680 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac34105-41ff-4cfa-951a-6a547b644b32 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:04.605878 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 359/736] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:15:04 2022] PUT /identity/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/9801d0694ec54d65bdd5b8914e05637e/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:15:04.619650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ab8f-12bf-4007-8e7f-863312c7ea7d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.637183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574ab8f-12bf-4007-8e7f-863312c7ea7d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.694826 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351aad-0c27-4626-8e2e-70da34ddca35 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.695137 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351aad-0c27-4626-8e2e-70da34ddca35 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.695385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12351aad-0c27-4626-8e2e-70da34ddca35 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.697525 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 360/737] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:15:04.705846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13d855-6348-4d30-9054-067ed350f971 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.705846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13d855-6348-4d30-9054-067ed350f971 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.705846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13d855-6348-4d30-9054-067ed350f971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.730779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-8f13d855-6348-4d30-9054-067ed350f971 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:04.731977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8f13d855-6348-4d30-9054-067ed350f971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:04.746388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2800fc-b024-422b-a19d-d50aec4c04c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.747064 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2800fc-b024-422b-a19d-d50aec4c04c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.747340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2800fc-b024-422b-a19d-d50aec4c04c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.747608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2800fc-b024-422b-a19d-d50aec4c04c2 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.748372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2800fc-b024-422b-a19d-d50aec4c04c2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.751208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-3f2800fc-b024-422b-a19d-d50aec4c04c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:15:04.751208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:15:04.751208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:15:04.752150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2800fc-b024-422b-a19d-d50aec4c04c2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:04.781889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 378/738] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:15:04 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:15:04.844173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 361/739] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:04 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:04.868877 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2800fc-b024-422b-a19d-d50aec4c04c2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.880223 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2800fc-b024-422b-a19d-d50aec4c04c2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.885061 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f21bd6-a66b-4bd5-a139-6e3a095d83e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.885859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f21bd6-a66b-4bd5-a139-6e3a095d83e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.886213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f21bd6-a66b-4bd5-a139-6e3a095d83e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.886489 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f21bd6-a66b-4bd5-a139-6e3a095d83e4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.899961 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f21bd6-a66b-4bd5-a139-6e3a095d83e4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:04.907929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-49f21bd6-a66b-4bd5-a139-6e3a095d83e4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:15:04.909581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 379/740] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:15:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:04.915584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13d855-6348-4d30-9054-067ed350f971 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.925909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13d855-6348-4d30-9054-067ed350f971 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.930608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a20f6-41a3-499a-b3c5-a4c3ef240ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.931337 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a20f6-41a3-499a-b3c5-a4c3ef240ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.931623 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a20f6-41a3-499a-b3c5-a4c3ef240ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.931895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a20f6-41a3-499a-b3c5-a4c3ef240ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.932683 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a20f6-41a3-499a-b3c5-a4c3ef240ff6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:04.932987 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a20f6-41a3-499a-b3c5-a4c3ef240ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.934751 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a20f6-41a3-499a-b3c5-a4c3ef240ff6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:04.945914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 362/741] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:15:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:04.951424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f21bd6-a66b-4bd5-a139-6e3a095d83e4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:04.963266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f21bd6-a66b-4bd5-a139-6e3a095d83e4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:04.968973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd28c2-c32f-484b-87b2-e8782e3efa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:04.969983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd28c2-c32f-484b-87b2-e8782e3efa15 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:04.970310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd28c2-c32f-484b-87b2-e8782e3efa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:04.970588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd28c2-c32f-484b-87b2-e8782e3efa15 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:04.982855 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd28c2-c32f-484b-87b2-e8782e3efa15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:04.985502 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd28c2-c32f-484b-87b2-e8782e3efa15 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:05.004097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-f3dd28c2-c32f-484b-87b2-e8782e3efa15 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:05.005663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 380/742] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:05.015886 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a20f6-41a3-499a-b3c5-a4c3ef240ff6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:05.027058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a20f6-41a3-499a-b3c5-a4c3ef240ff6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:05.038120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbe8ee-13da-4bc2-b0ce-10a2fa7fdc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:05.038847 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbe8ee-13da-4bc2-b0ce-10a2fa7fdc16 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:05.039113 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbe8ee-13da-4bc2-b0ce-10a2fa7fdc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:05.039390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbe8ee-13da-4bc2-b0ce-10a2fa7fdc16 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:05.040233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbe8ee-13da-4bc2-b0ce-10a2fa7fdc16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:05.040538 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbe8ee-13da-4bc2-b0ce-10a2fa7fdc16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:05.042207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbe8ee-13da-4bc2-b0ce-10a2fa7fdc16 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:05.056444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 363/743] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:05.062881 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd28c2-c32f-484b-87b2-e8782e3efa15 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:05.073083 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd28c2-c32f-484b-87b2-e8782e3efa15 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:05.078992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851775c-f088-4c2a-8add-74f52f22b659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:05.079735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851775c-f088-4c2a-8add-74f52f22b659 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:05.080074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851775c-f088-4c2a-8add-74f52f22b659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:05.080346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851775c-f088-4c2a-8add-74f52f22b659 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:05.088248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851775c-f088-4c2a-8add-74f52f22b659 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:05.090318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851775c-f088-4c2a-8add-74f52f22b659 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:05.105260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e851775c-f088-4c2a-8add-74f52f22b659 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 09:15:05.106668 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 381/744] 10.222.0.90 () {56 vars in 1138 bytes} [Wed Feb 16 09:15:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:05.112528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbe8ee-13da-4bc2-b0ce-10a2fa7fdc16 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:05.125035 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbe8ee-13da-4bc2-b0ce-10a2fa7fdc16 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:05.134288 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d39820-21e9-4293-8ff0-f51236ce6210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:05.134963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d39820-21e9-4293-8ff0-f51236ce6210 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:05.135244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d39820-21e9-4293-8ff0-f51236ce6210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:05.135565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d39820-21e9-4293-8ff0-f51236ce6210 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:05.136438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d39820-21e9-4293-8ff0-f51236ce6210 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:05.136794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d39820-21e9-4293-8ff0-f51236ce6210 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:05.138718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d39820-21e9-4293-8ff0-f51236ce6210 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:05.168329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 364/745] 10.222.0.90 () {56 vars in 1170 bytes} [Wed Feb 16 09:15:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:05.174055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851775c-f088-4c2a-8add-74f52f22b659 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:05.183712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851775c-f088-4c2a-8add-74f52f22b659 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:05.200725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ab02-c26f-43eb-891a-00465d267cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:05.201385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ab02-c26f-43eb-891a-00465d267cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:05.201663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ab02-c26f-43eb-891a-00465d267cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:05.201934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ab02-c26f-43eb-891a-00465d267cf5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:05.210774 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55ab02-c26f-43eb-891a-00465d267cf5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:05.212543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55ab02-c26f-43eb-891a-00465d267cf5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:05.222306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 382/746] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:05 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:15:05.227740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d39820-21e9-4293-8ff0-f51236ce6210 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:05.242108 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d39820-21e9-4293-8ff0-f51236ce6210 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:05.246893 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2de5d-ba9f-43de-8808-f4371bde64f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:05.247666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2de5d-ba9f-43de-8808-f4371bde64f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:05.247944 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2de5d-ba9f-43de-8808-f4371bde64f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:05.248237 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2de5d-ba9f-43de-8808-f4371bde64f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:05.262146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2de5d-ba9f-43de-8808-f4371bde64f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:05.263991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2de5d-ba9f-43de-8808-f4371bde64f7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:05.284838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-70a2de5d-ba9f-43de-8808-f4371bde64f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:05.286194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 365/747] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:05.291414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ab02-c26f-43eb-891a-00465d267cf5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:05.301295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ab02-c26f-43eb-891a-00465d267cf5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:05.313588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47abca-dfd7-4de2-b64c-2e7163a98b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:05.314501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47abca-dfd7-4de2-b64c-2e7163a98b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:05.314984 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47abca-dfd7-4de2-b64c-2e7163a98b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:05.315482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47abca-dfd7-4de2-b64c-2e7163a98b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:05.316441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47abca-dfd7-4de2-b64c-2e7163a98b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:05.316983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47abca-dfd7-4de2-b64c-2e7163a98b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:05.318760 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47abca-dfd7-4de2-b64c-2e7163a98b99 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:05.344195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 383/748] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:05.349843 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2de5d-ba9f-43de-8808-f4371bde64f7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:05.366653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2de5d-ba9f-43de-8808-f4371bde64f7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:05.377229 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d0b0f-4f6f-44a2-ac3f-50392d32cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:05.378033 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0b0f-4f6f-44a2-ac3f-50392d32cc2a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:05.378314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0b0f-4f6f-44a2-ac3f-50392d32cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:05.378572 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d0b0f-4f6f-44a2-ac3f-50392d32cc2a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:05.397219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d0b0f-4f6f-44a2-ac3f-50392d32cc2a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:05.399227 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d0b0f-4f6f-44a2-ac3f-50392d32cc2a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:05.416007 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-094d0b0f-4f6f-44a2-ac3f-50392d32cc2a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:05.417513 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 366/749] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:05.423232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47abca-dfd7-4de2-b64c-2e7163a98b99 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:05.443958 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47abca-dfd7-4de2-b64c-2e7163a98b99 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:05.458303 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a638b1d-176e-464c-b8ae-535c93a154ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:05.459758 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a638b1d-176e-464c-b8ae-535c93a154ef admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:05.460532 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a638b1d-176e-464c-b8ae-535c93a154ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:05.461178 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a638b1d-176e-464c-b8ae-535c93a154ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:05.462423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a638b1d-176e-464c-b8ae-535c93a154ef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:05.462953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a638b1d-176e-464c-b8ae-535c93a154ef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:05.465047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a638b1d-176e-464c-b8ae-535c93a154ef admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:05.489666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 384/750] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:05.495411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d0b0f-4f6f-44a2-ac3f-50392d32cc2a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:05.511156 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d0b0f-4f6f-44a2-ac3f-50392d32cc2a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:05.522776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72228d01-6d4c-4ab8-8de4-be7b73c377f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:05.523435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72228d01-6d4c-4ab8-8de4-be7b73c377f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:05.523715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72228d01-6d4c-4ab8-8de4-be7b73c377f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:05.523988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72228d01-6d4c-4ab8-8de4-be7b73c377f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:05.524835 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72228d01-6d4c-4ab8-8de4-be7b73c377f0 admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=ffcd409f87f84fe3bf25715e84c41af6) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:05.525138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72228d01-6d4c-4ab8-8de4-be7b73c377f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:05.526970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72228d01-6d4c-4ab8-8de4-be7b73c377f0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:05.536129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 367/751] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:05 2022] GET /identity/v3/role_assignments?user.id=ffcd409f87f84fe3bf25715e84c41af6&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:06.497647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ea81-4e64-4f71-9d89-b6c6cac2d816 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:06.498676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ea81-4e64-4f71-9d89-b6c6cac2d816 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:06.499380 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526ea81-4e64-4f71-9d89-b6c6cac2d816 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:06.501685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 385/752] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:06.507274 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddede72-3388-450b-a083-7df57107b8fa None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:06.508113 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddede72-3388-450b-a083-7df57107b8fa None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:06.508590 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddede72-3388-450b-a083-7df57107b8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:06.533046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-6ddede72-3388-450b-a083-7df57107b8fa None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:06.534251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6ddede72-3388-450b-a083-7df57107b8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:06.543747 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 368/753] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:06 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:06.589972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ea81-4e64-4f71-9d89-b6c6cac2d816 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:06.607398 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526ea81-4e64-4f71-9d89-b6c6cac2d816 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:06.617534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1c05e-d3f2-4ef0-97a4-288edba0c42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:06.618614 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1c05e-d3f2-4ef0-97a4-288edba0c42a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:06.619098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1c05e-d3f2-4ef0-97a4-288edba0c42a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:06.619567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1c05e-d3f2-4ef0-97a4-288edba0c42a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:06.633896 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1c05e-d3f2-4ef0-97a4-288edba0c42a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:06.641747 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-39d1c05e-d3f2-4ef0-97a4-288edba0c42a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:15:06.643164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 386/754] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:06.649147 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddede72-3388-450b-a083-7df57107b8fa None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:06.661988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddede72-3388-450b-a083-7df57107b8fa None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:06.674066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bbb0d-bc9e-4eae-9f1a-3690333fe2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:06.674739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bbb0d-bc9e-4eae-9f1a-3690333fe2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:06.675026 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bbb0d-bc9e-4eae-9f1a-3690333fe2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:06.675301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bbb0d-bc9e-4eae-9f1a-3690333fe2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:06.676064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bbb0d-bc9e-4eae-9f1a-3690333fe2f1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:06.676379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bbb0d-bc9e-4eae-9f1a-3690333fe2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:06.677975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bbb0d-bc9e-4eae-9f1a-3690333fe2f1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:06.694707 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 369/755] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:15:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:06.700288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1c05e-d3f2-4ef0-97a4-288edba0c42a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:06.716920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1c05e-d3f2-4ef0-97a4-288edba0c42a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:06.728210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e27278-57d9-4861-9463-375681a2473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:06.729280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e27278-57d9-4861-9463-375681a2473a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:06.729859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e27278-57d9-4861-9463-375681a2473a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:06.730330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e27278-57d9-4861-9463-375681a2473a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:06.751798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e27278-57d9-4861-9463-375681a2473a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:06.754029 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e27278-57d9-4861-9463-375681a2473a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:06.776000 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e6e27278-57d9-4861-9463-375681a2473a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:06.777842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 387/756] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:06.784347 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bbb0d-bc9e-4eae-9f1a-3690333fe2f1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:06.800653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bbb0d-bc9e-4eae-9f1a-3690333fe2f1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:06.808634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82fe79-fcf2-4236-a4d2-77288c735582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:06.809299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82fe79-fcf2-4236-a4d2-77288c735582 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:06.809581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82fe79-fcf2-4236-a4d2-77288c735582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:06.809856 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82fe79-fcf2-4236-a4d2-77288c735582 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:06.810580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82fe79-fcf2-4236-a4d2-77288c735582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:06.810883 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82fe79-fcf2-4236-a4d2-77288c735582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:06.812785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82fe79-fcf2-4236-a4d2-77288c735582 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:06.830702 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 370/757] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:06.838624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e27278-57d9-4861-9463-375681a2473a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:06.859567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e27278-57d9-4861-9463-375681a2473a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:06.869543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47e5f2-13f1-48ea-815f-9469dae14681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:06.871018 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47e5f2-13f1-48ea-815f-9469dae14681 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:06.871712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47e5f2-13f1-48ea-815f-9469dae14681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:06.872411 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47e5f2-13f1-48ea-815f-9469dae14681 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:06.886652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47e5f2-13f1-48ea-815f-9469dae14681 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:06.888961 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47e5f2-13f1-48ea-815f-9469dae14681 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:06.909195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-5f47e5f2-13f1-48ea-815f-9469dae14681 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 09:15:06.910805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 388/758] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:06.916918 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82fe79-fcf2-4236-a4d2-77288c735582 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:06.933335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82fe79-fcf2-4236-a4d2-77288c735582 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:06.949518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00142900-cfd0-41e5-9d74-09cc68e48996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:06.950205 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00142900-cfd0-41e5-9d74-09cc68e48996 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:06.950491 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00142900-cfd0-41e5-9d74-09cc68e48996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:06.950772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00142900-cfd0-41e5-9d74-09cc68e48996 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:06.951612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00142900-cfd0-41e5-9d74-09cc68e48996 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:06.951922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00142900-cfd0-41e5-9d74-09cc68e48996 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:06.954399 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00142900-cfd0-41e5-9d74-09cc68e48996 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:06.979527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 371/759] 10.222.0.90 () {56 vars in 1156 bytes} [Wed Feb 16 09:15:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:06.985920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47e5f2-13f1-48ea-815f-9469dae14681 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:06.996066 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47e5f2-13f1-48ea-815f-9469dae14681 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.004219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e605e-fdc5-49e8-8e25-cf7b313fc00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.005142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e605e-fdc5-49e8-8e25-cf7b313fc00e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.005638 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e605e-fdc5-49e8-8e25-cf7b313fc00e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.006107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e605e-fdc5-49e8-8e25-cf7b313fc00e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.021206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e605e-fdc5-49e8-8e25-cf7b313fc00e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.022982 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e605e-fdc5-49e8-8e25-cf7b313fc00e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.039184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 389/760] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:06 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:15:07.044910 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00142900-cfd0-41e5-9d74-09cc68e48996 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.063484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00142900-cfd0-41e5-9d74-09cc68e48996 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.076658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dad6a-a2af-4f96-b89a-8bbe07b1b1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.077640 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dad6a-a2af-4f96-b89a-8bbe07b1b1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.077931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dad6a-a2af-4f96-b89a-8bbe07b1b1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.078211 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dad6a-a2af-4f96-b89a-8bbe07b1b1b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.089049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dad6a-a2af-4f96-b89a-8bbe07b1b1b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.090881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dad6a-a2af-4f96-b89a-8bbe07b1b1b9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.122086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-0c5dad6a-a2af-4f96-b89a-8bbe07b1b1b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:07.123661 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 372/761] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:07.129650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e605e-fdc5-49e8-8e25-cf7b313fc00e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.143966 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e605e-fdc5-49e8-8e25-cf7b313fc00e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.144307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5d526-54ea-4d23-b989-57db6c626087 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.144521 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5d526-54ea-4d23-b989-57db6c626087 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.144918 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5d526-54ea-4d23-b989-57db6c626087 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.148214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 373/762] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:07.156176 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d49863-dbb2-4958-a683-4c43d9e9a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.156349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ae9a4-8927-46bc-9f66-7e1e4c5e6923 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.156730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ae9a4-8927-46bc-9f66-7e1e4c5e6923 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.157136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ae9a4-8927-46bc-9f66-7e1e4c5e6923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.157684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49863-dbb2-4958-a683-4c43d9e9a641 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.158167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49863-dbb2-4958-a683-4c43d9e9a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.158628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d49863-dbb2-4958-a683-4c43d9e9a641 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.159631 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d49863-dbb2-4958-a683-4c43d9e9a641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:07.160186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d49863-dbb2-4958-a683-4c43d9e9a641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.161970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d49863-dbb2-4958-a683-4c43d9e9a641 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.176308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 390/763] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:07.183847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d49863-dbb2-4958-a683-4c43d9e9a641 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.198307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-2d4ae9a4-8927-46bc-9f66-7e1e4c5e6923 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:07.199494 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2d4ae9a4-8927-46bc-9f66-7e1e4c5e6923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:07.204111 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d49863-dbb2-4958-a683-4c43d9e9a641 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.210158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 374/764] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:07 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:07.220741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570059aa-e618-4616-a6f7-61048260bccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.221549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570059aa-e618-4616-a6f7-61048260bccf admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.221826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570059aa-e618-4616-a6f7-61048260bccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.222096 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570059aa-e618-4616-a6f7-61048260bccf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.235540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570059aa-e618-4616-a6f7-61048260bccf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.235718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ae9a4-8927-46bc-9f66-7e1e4c5e6923 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.237542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570059aa-e618-4616-a6f7-61048260bccf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.245827 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ae9a4-8927-46bc-9f66-7e1e4c5e6923 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.251178 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9a6e4-27ed-47ae-ae48-abf58e52170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.252002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9a6e4-27ed-47ae-ae48-abf58e52170b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.252311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9a6e4-27ed-47ae-ae48-abf58e52170b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.252583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9a6e4-27ed-47ae-ae48-abf58e52170b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.253243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9a6e4-27ed-47ae-ae48-abf58e52170b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.254332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-06b9a6e4-27ed-47ae-ae48-abf58e52170b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:15:07.254332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:15:07.254332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:15:07.255168 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9a6e4-27ed-47ae-ae48-abf58e52170b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.263078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-570059aa-e618-4616-a6f7-61048260bccf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:07.269544 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-06b9a6e4-27ed-47ae-ae48-abf58e52170b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 16 09:15:07.270148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 391/765] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:07.271308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 375/766] 10.222.0.90 () {56 vars in 1150 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:07.272175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570059aa-e618-4616-a6f7-61048260bccf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.276986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9a6e4-27ed-47ae-ae48-abf58e52170b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.287463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9a6e4-27ed-47ae-ae48-abf58e52170b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.297773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b872a23-2738-46c5-bb37-d05752e4c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.298552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b872a23-2738-46c5-bb37-d05752e4c2aa admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.298799 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570059aa-e618-4616-a6f7-61048260bccf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.298926 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b872a23-2738-46c5-bb37-d05752e4c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.299092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b872a23-2738-46c5-bb37-d05752e4c2aa admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.299948 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b872a23-2738-46c5-bb37-d05752e4c2aa admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:07.300300 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b872a23-2738-46c5-bb37-d05752e4c2aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.302005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b872a23-2738-46c5-bb37-d05752e4c2aa admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.307704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 376/767] 10.222.0.90 () {56 vars in 1145 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:07.314016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b872a23-2738-46c5-bb37-d05752e4c2aa admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.317408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4e0ea-1554-4025-a1f4-135708005be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.318073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4e0ea-1554-4025-a1f4-135708005be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.318353 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4e0ea-1554-4025-a1f4-135708005be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.318626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4e0ea-1554-4025-a1f4-135708005be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.319407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4e0ea-1554-4025-a1f4-135708005be4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:07.319710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4e0ea-1554-4025-a1f4-135708005be4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.321586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4e0ea-1554-4025-a1f4-135708005be4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.324450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b872a23-2738-46c5-bb37-d05752e4c2aa admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.329573 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddce8e1-5f90-488e-bfc7-68841c463438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.330230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddce8e1-5f90-488e-bfc7-68841c463438 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.330512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddce8e1-5f90-488e-bfc7-68841c463438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.331322 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddce8e1-5f90-488e-bfc7-68841c463438 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.332043 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddce8e1-5f90-488e-bfc7-68841c463438 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:07.332375 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddce8e1-5f90-488e-bfc7-68841c463438 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.334795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddce8e1-5f90-488e-bfc7-68841c463438 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.336608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 392/768] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:07.338095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d064c-f0f4-4083-9d3c-20b01a206a6b None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.338434 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d064c-f0f4-4083-9d3c-20b01a206a6b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.338716 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d064c-f0f4-4083-9d3c-20b01a206a6b None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.340628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 393/769] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:07.341600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 377/770] 10.222.0.90 () {56 vars in 1145 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:07.346381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d064c-f0f4-4083-9d3c-20b01a206a6b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.347163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ec5e8-5835-4f11-9281-dace68cf0fc3 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.347565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ec5e8-5835-4f11-9281-dace68cf0fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.347848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ec5e8-5835-4f11-9281-dace68cf0fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.363465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d064c-f0f4-4083-9d3c-20b01a206a6b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.368621 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02276a69-d27f-4274-ad7d-9faf57bedd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.369284 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02276a69-d27f-4274-ad7d-9faf57bedd9d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.369616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02276a69-d27f-4274-ad7d-9faf57bedd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.369900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02276a69-d27f-4274-ad7d-9faf57bedd9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.370858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02276a69-d27f-4274-ad7d-9faf57bedd9d admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=faf1f200fb2b4a2fb75b971054885eef) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:07.371222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02276a69-d27f-4274-ad7d-9faf57bedd9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.373575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02276a69-d27f-4274-ad7d-9faf57bedd9d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.373792 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0d2ec5e8-5835-4f11-9281-dace68cf0fc3 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:07.375551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0d2ec5e8-5835-4f11-9281-dace68cf0fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:07.381627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 394/771] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/role_assignments?user.id=faf1f200fb2b4a2fb75b971054885eef&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=0e45946c6336419abb2015d8916e31ca => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:07.382568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02276a69-d27f-4274-ad7d-9faf57bedd9d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.385068 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 378/772] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:07 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:07.401616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02276a69-d27f-4274-ad7d-9faf57bedd9d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.411490 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe57f4-70d1-4816-b1fa-a08e3da1f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.412228 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe57f4-70d1-4816-b1fa-a08e3da1f536 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.412515 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe57f4-70d1-4816-b1fa-a08e3da1f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.412962 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe57f4-70d1-4816-b1fa-a08e3da1f536 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.413596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe57f4-70d1-4816-b1fa-a08e3da1f536 admin admin] RBAC: Adding query filter params (interface=public, service_id=6555c43e716e4076adcd98808065e05f, region_id=RegionOne) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:07.413871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ec5e8-5835-4f11-9281-dace68cf0fc3 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.414070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe57f4-70d1-4816-b1fa-a08e3da1f536 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.414932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-cebe57f4-70d1-4816-b1fa-a08e3da1f536 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:15:07.414932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:15:07.414932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:15:07.415824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe57f4-70d1-4816-b1fa-a08e3da1f536 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.425800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ec5e8-5835-4f11-9281-dace68cf0fc3 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.431707 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27d70b-df26-401f-94a3-f3412fe1bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.432014 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 395/773] 10.222.0.90 () {56 vars in 1272 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/endpoints?service_id=6555c43e716e4076adcd98808065e05f&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:07.432589 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27d70b-df26-401f-94a3-f3412fe1bd6b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.432966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27d70b-df26-401f-94a3-f3412fe1bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.433304 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27d70b-df26-401f-94a3-f3412fe1bd6b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.438159 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe57f4-70d1-4816-b1fa-a08e3da1f536 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.447825 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27d70b-df26-401f-94a3-f3412fe1bd6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:07.456813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-ae27d70b-df26-401f-94a3-f3412fe1bd6b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:15:07.458495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 379/774] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:07.464673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27d70b-df26-401f-94a3-f3412fe1bd6b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.465504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe57f4-70d1-4816-b1fa-a08e3da1f536 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.476587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27d70b-df26-401f-94a3-f3412fe1bd6b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.478380 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f22156-ccac-4e4d-a0ce-af502341638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.479254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f22156-ccac-4e4d-a0ce-af502341638c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.479633 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f22156-ccac-4e4d-a0ce-af502341638c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.479950 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f22156-ccac-4e4d-a0ce-af502341638c admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.480663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f22156-ccac-4e4d-a0ce-af502341638c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.481555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d249923-b20c-4d66-8a31-78afa515c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.482328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d249923-b20c-4d66-8a31-78afa515c3af admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.482501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f22156-ccac-4e4d-a0ce-af502341638c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.482649 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d249923-b20c-4d66-8a31-78afa515c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.482872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d249923-b20c-4d66-8a31-78afa515c3af admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.484983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d249923-b20c-4d66-8a31-78afa515c3af admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:07.485500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d249923-b20c-4d66-8a31-78afa515c3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.487614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d249923-b20c-4d66-8a31-78afa515c3af admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.496939 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 396/775] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/services => generated 772 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:07.504438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 380/776] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:07.506073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f22156-ccac-4e4d-a0ce-af502341638c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.526551 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f22156-ccac-4e4d-a0ce-af502341638c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.540971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cb736-4ee6-4062-83b7-823e196b607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.541787 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb736-4ee6-4062-83b7-823e196b607d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.542069 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb736-4ee6-4062-83b7-823e196b607d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.542343 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb736-4ee6-4062-83b7-823e196b607d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.558682 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cb736-4ee6-4062-83b7-823e196b607d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.560578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cb736-4ee6-4062-83b7-823e196b607d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.582060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-236cb736-4ee6-4062-83b7-823e196b607d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:07.583498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 397/777] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:07.589446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d249923-b20c-4d66-8a31-78afa515c3af admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.604398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d249923-b20c-4d66-8a31-78afa515c3af admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.612037 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58d4fb-837b-41d8-a36e-c45f46c8ad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.613096 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58d4fb-837b-41d8-a36e-c45f46c8ad79 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.613599 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58d4fb-837b-41d8-a36e-c45f46c8ad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.614112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58d4fb-837b-41d8-a36e-c45f46c8ad79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.615324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58d4fb-837b-41d8-a36e-c45f46c8ad79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:07.615855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58d4fb-837b-41d8-a36e-c45f46c8ad79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.617971 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58d4fb-837b-41d8-a36e-c45f46c8ad79 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.633182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 381/778] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:07.639282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cb736-4ee6-4062-83b7-823e196b607d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.653567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cb736-4ee6-4062-83b7-823e196b607d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.662751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fa4c4-c985-4d21-a075-5aadcc3d092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.663536 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fa4c4-c985-4d21-a075-5aadcc3d092b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.663823 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fa4c4-c985-4d21-a075-5aadcc3d092b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.664125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fa4c4-c985-4d21-a075-5aadcc3d092b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.681448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fa4c4-c985-4d21-a075-5aadcc3d092b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.683553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8fa4c4-c985-4d21-a075-5aadcc3d092b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.700544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-2b8fa4c4-c985-4d21-a075-5aadcc3d092b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 09:15:07.702044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 398/779] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:07.708726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58d4fb-837b-41d8-a36e-c45f46c8ad79 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.720778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58d4fb-837b-41d8-a36e-c45f46c8ad79 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.734343 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846bd1a-1dd8-4da8-af35-8699043607b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.735152 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846bd1a-1dd8-4da8-af35-8699043607b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.735438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846bd1a-1dd8-4da8-af35-8699043607b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.735717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846bd1a-1dd8-4da8-af35-8699043607b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.736642 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846bd1a-1dd8-4da8-af35-8699043607b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:07.736950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846bd1a-1dd8-4da8-af35-8699043607b1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.738977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846bd1a-1dd8-4da8-af35-8699043607b1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.759244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 382/780] 10.222.0.90 () {56 vars in 1154 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:07.764770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fa4c4-c985-4d21-a075-5aadcc3d092b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.779974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fa4c4-c985-4d21-a075-5aadcc3d092b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.787814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a17e3-ede7-465a-b111-2b1e51f429d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.788778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a17e3-ede7-465a-b111-2b1e51f429d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.789268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a17e3-ede7-465a-b111-2b1e51f429d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.789779 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a17e3-ede7-465a-b111-2b1e51f429d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.802725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a17e3-ede7-465a-b111-2b1e51f429d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.804838 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a17e3-ede7-465a-b111-2b1e51f429d8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.816239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 399/781] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:15:07.822045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846bd1a-1dd8-4da8-af35-8699043607b1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.834365 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846bd1a-1dd8-4da8-af35-8699043607b1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.848723 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6df7e-ee8c-4f78-8806-63e20e29a5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.849528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6df7e-ee8c-4f78-8806-63e20e29a5de admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.849809 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6df7e-ee8c-4f78-8806-63e20e29a5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.850086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6df7e-ee8c-4f78-8806-63e20e29a5de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.861162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6df7e-ee8c-4f78-8806-63e20e29a5de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.863026 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6df7e-ee8c-4f78-8806-63e20e29a5de admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.874068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b6c6-5147-4191-82da-b9b0615cceba None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.874705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b6c6-5147-4191-82da-b9b0615cceba None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.875188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07b6c6-5147-4191-82da-b9b0615cceba None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.877190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 400/782] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:15:07.882688 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155f4d-a4f2-473d-9588-ef4b7531abb8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.882973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155f4d-a4f2-473d-9588-ef4b7531abb8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.883252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155f4d-a4f2-473d-9588-ef4b7531abb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.893651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-16a6df7e-ee8c-4f78-8806-63e20e29a5de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:07.895140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 383/783] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:07.905890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6df7e-ee8c-4f78-8806-63e20e29a5de admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.917552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-8a155f4d-a4f2-473d-9588-ef4b7531abb8 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:07.918752 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8a155f4d-a4f2-473d-9588-ef4b7531abb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:07.923085 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6df7e-ee8c-4f78-8806-63e20e29a5de admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.932777 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6864adb-0e08-43eb-a6ac-c93fbf27ea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.933442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6864adb-0e08-43eb-a6ac-c93fbf27ea63 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.933725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6864adb-0e08-43eb-a6ac-c93fbf27ea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.934004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6864adb-0e08-43eb-a6ac-c93fbf27ea63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.934725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6864adb-0e08-43eb-a6ac-c93fbf27ea63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:07.935030 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6864adb-0e08-43eb-a6ac-c93fbf27ea63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.936983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6864adb-0e08-43eb-a6ac-c93fbf27ea63 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.939988 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 401/784] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:07 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:07.950797 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 384/785] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:07.956744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155f4d-a4f2-473d-9588-ef4b7531abb8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.966243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155f4d-a4f2-473d-9588-ef4b7531abb8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.974766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6864adb-0e08-43eb-a6ac-c93fbf27ea63 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:07.984606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a93465-854e-4905-aa7e-93b3b8105e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.985408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a93465-854e-4905-aa7e-93b3b8105e22 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:07.985693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a93465-854e-4905-aa7e-93b3b8105e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:07.985967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a93465-854e-4905-aa7e-93b3b8105e22 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:07.988991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6864adb-0e08-43eb-a6ac-c93fbf27ea63 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:07.996751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a93465-854e-4905-aa7e-93b3b8105e22 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:07.998201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faf9d7-382c-449d-9547-a568f171467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:07.998714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a93465-854e-4905-aa7e-93b3b8105e22 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:07.999565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faf9d7-382c-449d-9547-a568f171467c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.000196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faf9d7-382c-449d-9547-a568f171467c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.000663 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3faf9d7-382c-449d-9547-a568f171467c admin admin] PATH_INFO: `/v3/services/network` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.001563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faf9d7-382c-449d-9547-a568f171467c admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:08.003436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3faf9d7-382c-449d-9547-a568f171467c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:08.021693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-f3faf9d7-382c-449d-9547-a568f171467c admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 16 09:15:08.023452 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 385/786] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/services/network => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:08.027542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-99a93465-854e-4905-aa7e-93b3b8105e22 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:08.028828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 402/787] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:08.029361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faf9d7-382c-449d-9547-a568f171467c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:08.034792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a93465-854e-4905-aa7e-93b3b8105e22 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:08.049816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3faf9d7-382c-449d-9547-a568f171467c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:08.061909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d95b2c-5fb7-4776-a9d2-a0ba836f38fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:08.063133 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d95b2c-5fb7-4776-a9d2-a0ba836f38fb admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.063687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d95b2c-5fb7-4776-a9d2-a0ba836f38fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.068370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d95b2c-5fb7-4776-a9d2-a0ba836f38fb admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.069502 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d95b2c-5fb7-4776-a9d2-a0ba836f38fb admin admin] RBAC: Adding query filter params (name=network) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:08.070060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d95b2c-5fb7-4776-a9d2-a0ba836f38fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:08.071998 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d95b2c-5fb7-4776-a9d2-a0ba836f38fb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:08.079939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 386/788] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:08.085764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d95b2c-5fb7-4776-a9d2-a0ba836f38fb admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:08.101596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d95b2c-5fb7-4776-a9d2-a0ba836f38fb admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:08.113753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0064-0798-4e54-bef2-723589fde98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:08.114859 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0064-0798-4e54-bef2-723589fde98c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.115368 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0064-0798-4e54-bef2-723589fde98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.115849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0064-0798-4e54-bef2-723589fde98c admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.116887 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0064-0798-4e54-bef2-723589fde98c admin admin] RBAC: Adding query filter params (type=network) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:08.117395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0064-0798-4e54-bef2-723589fde98c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:08.119284 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0064-0798-4e54-bef2-723589fde98c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:08.132713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 387/789] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:08.138654 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0064-0798-4e54-bef2-723589fde98c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:08.161675 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0064-0798-4e54-bef2-723589fde98c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:08.176497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91567396-a018-4550-8e88-3153ef3cd2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:08.177177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91567396-a018-4550-8e88-3153ef3cd2de admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.177458 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91567396-a018-4550-8e88-3153ef3cd2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.177739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91567396-a018-4550-8e88-3153ef3cd2de admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.178533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91567396-a018-4550-8e88-3153ef3cd2de admin admin] RBAC: Adding query filter params (interface=public, service_id=829ef0d140a24936b314dc6b00824f6a, region_id=RegionOne) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:08.178846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91567396-a018-4550-8e88-3153ef3cd2de admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:08.179871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-91567396-a018-4550-8e88-3153ef3cd2de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:15:08.179871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:15:08.179871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:15:08.180798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91567396-a018-4550-8e88-3153ef3cd2de admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:08.192043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a93465-854e-4905-aa7e-93b3b8105e22 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:08.197244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 388/790] 10.222.0.90 () {56 vars in 1272 bytes} [Wed Feb 16 09:15:08 2022] GET /identity/v3/endpoints?service_id=829ef0d140a24936b314dc6b00824f6a&interface=public®ion_id=RegionOne => generated 194 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:08.200164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639df28-0312-490a-8ee2-ecedec20aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:08.200799 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639df28-0312-490a-8ee2-ecedec20aace admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.201135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639df28-0312-490a-8ee2-ecedec20aace admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.201416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639df28-0312-490a-8ee2-ecedec20aace admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.202239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639df28-0312-490a-8ee2-ecedec20aace admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:08.202545 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639df28-0312-490a-8ee2-ecedec20aace admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:08.204432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639df28-0312-490a-8ee2-ecedec20aace admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:08.207218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91567396-a018-4550-8e88-3153ef3cd2de admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:08.217379 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 403/791] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:08.224441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639df28-0312-490a-8ee2-ecedec20aace admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:08.227362 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91567396-a018-4550-8e88-3153ef3cd2de admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:08.234753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639df28-0312-490a-8ee2-ecedec20aace admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:08.237206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db956024-291f-4e2c-9a39-857020fd616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:08.237974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956024-291f-4e2c-9a39-857020fd616e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.238243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956024-291f-4e2c-9a39-857020fd616e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.238513 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db956024-291f-4e2c-9a39-857020fd616e admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.239282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db956024-291f-4e2c-9a39-857020fd616e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:08.239783 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a2b96-fb73-4b5e-9fd4-7ff5b4418300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:08.240595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2b96-fb73-4b5e-9fd4-7ff5b4418300 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.240908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db956024-291f-4e2c-9a39-857020fd616e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:08.241182 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2b96-fb73-4b5e-9fd4-7ff5b4418300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.241625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2b96-fb73-4b5e-9fd4-7ff5b4418300 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.242790 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a2b96-fb73-4b5e-9fd4-7ff5b4418300 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=9801d0694ec54d65bdd5b8914e05637e) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:08.243260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a2b96-fb73-4b5e-9fd4-7ff5b4418300 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:08.245253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a2b96-fb73-4b5e-9fd4-7ff5b4418300 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:08.256409 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 404/792] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:08 2022] GET /identity/v3/role_assignments?user.id=9801d0694ec54d65bdd5b8914e05637e&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=0e45946c6336419abb2015d8916e31ca => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:08.258693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 389/793] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Feb 16 09:15:08 2022] GET /identity/v3/services => generated 772 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:08.624815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea809bb-43c8-4b00-8ee5-aa798feb6ab5 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.625885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea809bb-43c8-4b00-8ee5-aa798feb6ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.626382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea809bb-43c8-4b00-8ee5-aa798feb6ab5 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.628666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 405/794] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:08.634409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dd090-01da-48e1-aa9e-662105cd6f43 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.634868 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dd090-01da-48e1-aa9e-662105cd6f43 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.634943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6dd090-01da-48e1-aa9e-662105cd6f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.661108 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-ef6dd090-01da-48e1-aa9e-662105cd6f43 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:08.662315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ef6dd090-01da-48e1-aa9e-662105cd6f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:08.674606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 390/795] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:08 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:08.704782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea809bb-43c8-4b00-8ee5-aa798feb6ab5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:08.725664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea809bb-43c8-4b00-8ee5-aa798feb6ab5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:08.736746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97733e7-3ffb-484b-91b2-5603f26fff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:08.737862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97733e7-3ffb-484b-91b2-5603f26fff29 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.738367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97733e7-3ffb-484b-91b2-5603f26fff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.738852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97733e7-3ffb-484b-91b2-5603f26fff29 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.753527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97733e7-3ffb-484b-91b2-5603f26fff29 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:08.760826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-d97733e7-3ffb-484b-91b2-5603f26fff29 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:15:08.767888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 406/796] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:15:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:08.768920 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dd090-01da-48e1-aa9e-662105cd6f43 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:08.782960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6dd090-01da-48e1-aa9e-662105cd6f43 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:08.792130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf911a5-1ea5-4990-b2b0-c75bd5015cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:08.792802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf911a5-1ea5-4990-b2b0-c75bd5015cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.793085 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf911a5-1ea5-4990-b2b0-c75bd5015cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.793360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf911a5-1ea5-4990-b2b0-c75bd5015cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.794111 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf911a5-1ea5-4990-b2b0-c75bd5015cb6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:08.794416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf911a5-1ea5-4990-b2b0-c75bd5015cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:08.796090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf911a5-1ea5-4990-b2b0-c75bd5015cb6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:08.812018 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 391/797] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:15:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:08.817832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97733e7-3ffb-484b-91b2-5603f26fff29 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:08.831483 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97733e7-3ffb-484b-91b2-5603f26fff29 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:08.841301 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571bf95-da26-4f64-88cd-0082f133f04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:08.842384 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571bf95-da26-4f64-88cd-0082f133f04b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.842972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571bf95-da26-4f64-88cd-0082f133f04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.843470 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571bf95-da26-4f64-88cd-0082f133f04b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.859115 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571bf95-da26-4f64-88cd-0082f133f04b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:08.861319 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571bf95-da26-4f64-88cd-0082f133f04b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:08.892662 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e571bf95-da26-4f64-88cd-0082f133f04b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:08.894993 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 407/798] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:08.899889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf911a5-1ea5-4990-b2b0-c75bd5015cb6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:08.913767 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf911a5-1ea5-4990-b2b0-c75bd5015cb6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:08.929589 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2e39c-7a02-4623-be68-5f83eb3c4d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:08.930258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2e39c-7a02-4623-be68-5f83eb3c4d7c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.930541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2e39c-7a02-4623-be68-5f83eb3c4d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.930815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2e39c-7a02-4623-be68-5f83eb3c4d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:08.931534 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2e39c-7a02-4623-be68-5f83eb3c4d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:08.931837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2e39c-7a02-4623-be68-5f83eb3c4d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:08.933470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2e39c-7a02-4623-be68-5f83eb3c4d7c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:08.954036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 392/799] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:08.959888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571bf95-da26-4f64-88cd-0082f133f04b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:08.974491 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571bf95-da26-4f64-88cd-0082f133f04b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:08.988652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd3ea0-d3be-46bc-a6bd-4c502bbfa0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:08.989461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd3ea0-d3be-46bc-a6bd-4c502bbfa0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:08.989734 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd3ea0-d3be-46bc-a6bd-4c502bbfa0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:08.990049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd3ea0-d3be-46bc-a6bd-4c502bbfa0a2 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:09.001100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd3ea0-d3be-46bc-a6bd-4c502bbfa0a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:09.003101 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd3ea0-d3be-46bc-a6bd-4c502bbfa0a2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:09.027999 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-6fcd3ea0-d3be-46bc-a6bd-4c502bbfa0a2 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 09:15:09.029541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 408/800] 10.222.0.90 () {56 vars in 1138 bytes} [Wed Feb 16 09:15:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:09.035828 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2e39c-7a02-4623-be68-5f83eb3c4d7c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:09.058270 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2e39c-7a02-4623-be68-5f83eb3c4d7c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:09.073562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d02495-da8b-4235-aab7-b3cd1cf22bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:09.074226 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d02495-da8b-4235-aab7-b3cd1cf22bfe admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:09.074509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d02495-da8b-4235-aab7-b3cd1cf22bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:09.074782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d02495-da8b-4235-aab7-b3cd1cf22bfe admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:09.075610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d02495-da8b-4235-aab7-b3cd1cf22bfe admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:09.075917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d02495-da8b-4235-aab7-b3cd1cf22bfe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:09.077855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d02495-da8b-4235-aab7-b3cd1cf22bfe admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:09.115343 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 393/801] 10.222.0.90 () {56 vars in 1170 bytes} [Wed Feb 16 09:15:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:09.121068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd3ea0-d3be-46bc-a6bd-4c502bbfa0a2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:09.136836 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd3ea0-d3be-46bc-a6bd-4c502bbfa0a2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:09.144735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12905d8-ae22-4172-8e4d-1d0cdbc30c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:09.145448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12905d8-ae22-4172-8e4d-1d0cdbc30c6b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:09.145729 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12905d8-ae22-4172-8e4d-1d0cdbc30c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:09.146004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12905d8-ae22-4172-8e4d-1d0cdbc30c6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:09.167563 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12905d8-ae22-4172-8e4d-1d0cdbc30c6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:09.169419 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12905d8-ae22-4172-8e4d-1d0cdbc30c6b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:09.194036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e12905d8-ae22-4172-8e4d-1d0cdbc30c6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:09.199630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 409/802] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:09.200908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d02495-da8b-4235-aab7-b3cd1cf22bfe admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:09.214290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d02495-da8b-4235-aab7-b3cd1cf22bfe admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:09.229550 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea78e4-26d7-48bf-8f4b-6e006babe426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:09.230218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea78e4-26d7-48bf-8f4b-6e006babe426 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:09.230497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea78e4-26d7-48bf-8f4b-6e006babe426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:09.230769 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea78e4-26d7-48bf-8f4b-6e006babe426 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:09.231484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea78e4-26d7-48bf-8f4b-6e006babe426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:09.231790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea78e4-26d7-48bf-8f4b-6e006babe426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:09.233578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea78e4-26d7-48bf-8f4b-6e006babe426 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:09.253734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 394/803] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:09.259196 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12905d8-ae22-4172-8e4d-1d0cdbc30c6b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:09.273805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12905d8-ae22-4172-8e4d-1d0cdbc30c6b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:09.281389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44508ec2-ddd3-4ba1-9007-b38ebad7f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:09.282176 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44508ec2-ddd3-4ba1-9007-b38ebad7f838 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:09.282455 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44508ec2-ddd3-4ba1-9007-b38ebad7f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:09.282725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44508ec2-ddd3-4ba1-9007-b38ebad7f838 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:09.290168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44508ec2-ddd3-4ba1-9007-b38ebad7f838 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:09.292129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44508ec2-ddd3-4ba1-9007-b38ebad7f838 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:09.305947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-44508ec2-ddd3-4ba1-9007-b38ebad7f838 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:09.307327 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 410/804] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:09.313386 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea78e4-26d7-48bf-8f4b-6e006babe426 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:09.323274 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea78e4-26d7-48bf-8f4b-6e006babe426 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:09.328791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e96730-a81f-45bc-b8f1-fe3bfa80707c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:09.329486 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e96730-a81f-45bc-b8f1-fe3bfa80707c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:09.329768 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e96730-a81f-45bc-b8f1-fe3bfa80707c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:09.330039 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e96730-a81f-45bc-b8f1-fe3bfa80707c admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:09.330858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e96730-a81f-45bc-b8f1-fe3bfa80707c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:09.331163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e96730-a81f-45bc-b8f1-fe3bfa80707c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:09.333076 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e96730-a81f-45bc-b8f1-fe3bfa80707c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:09.347928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 395/805] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:09.353783 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44508ec2-ddd3-4ba1-9007-b38ebad7f838 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:09.365900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44508ec2-ddd3-4ba1-9007-b38ebad7f838 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:09.370497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cc8ad-8a70-436d-ba33-4e94ece7aefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:09.371427 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cc8ad-8a70-436d-ba33-4e94ece7aefa admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:09.371742 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cc8ad-8a70-436d-ba33-4e94ece7aefa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:09.372034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cc8ad-8a70-436d-ba33-4e94ece7aefa admin admin] PATH_INFO: `/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/ffcd409f87f84fe3bf25715e84c41af6/roles/068cd8712b8547b89967dd5d7964007b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:09.390983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cc8ad-8a70-436d-ba33-4e94ece7aefa admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ab51e6e2745658b252fbafdc2f8ef, user_id=ffcd409f87f84fe3bf25715e84c41af6, role_id=068cd8712b8547b89967dd5d7964007b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:09.394016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cc8ad-8a70-436d-ba33-4e94ece7aefa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:09.414396 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 411/806] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:15:09 2022] PUT /identity/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/ffcd409f87f84fe3bf25715e84c41af6/roles/068cd8712b8547b89967dd5d7964007b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:15:10.306396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f979f0-eeb2-4e94-8ace-4b73be31ed31 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.306890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f979f0-eeb2-4e94-8ace-4b73be31ed31 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.306890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f979f0-eeb2-4e94-8ace-4b73be31ed31 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.308634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 396/807] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:10.314708 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e591983-339a-46d4-a283-37ab66485c1b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.315132 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e591983-339a-46d4-a283-37ab66485c1b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.315334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e591983-339a-46d4-a283-37ab66485c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.340476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de7bff-eb5a-4ef3-ab45-7c4cdb3699ee None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.340763 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de7bff-eb5a-4ef3-ab45-7c4cdb3699ee None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.341021 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de7bff-eb5a-4ef3-ab45-7c4cdb3699ee None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.343914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 397/808] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:10.344442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4e591983-339a-46d4-a283-37ab66485c1b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:10.345802 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4e591983-339a-46d4-a283-37ab66485c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:10.349632 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f31a84-0d0e-4968-aeb8-167b39a5f571 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.349919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f31a84-0d0e-4968-aeb8-167b39a5f571 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.350195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f31a84-0d0e-4968-aeb8-167b39a5f571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.371744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-48f31a84-0d0e-4968-aeb8-167b39a5f571 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:10.372990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-48f31a84-0d0e-4968-aeb8-167b39a5f571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:10.447514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 412/809] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:10 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:10.481577 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 398/810] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:10 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:10.490126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e591983-339a-46d4-a283-37ab66485c1b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:10.502662 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e591983-339a-46d4-a283-37ab66485c1b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:10.504988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f31a84-0d0e-4968-aeb8-167b39a5f571 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:10.515836 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c1199-7496-4af6-aed5-a6845ed85230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:10.516817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c1199-7496-4af6-aed5-a6845ed85230 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.517100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c1199-7496-4af6-aed5-a6845ed85230 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.517372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c1199-7496-4af6-aed5-a6845ed85230 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.518037 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c1199-7496-4af6-aed5-a6845ed85230 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:10.519638 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c1199-7496-4af6-aed5-a6845ed85230 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:10.522142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f31a84-0d0e-4968-aeb8-167b39a5f571 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:10.529688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b537a1-c574-4eb6-b5ad-cd1b1ff1bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:10.531052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b537a1-c574-4eb6-b5ad-cd1b1ff1bde7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.531486 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b537a1-c574-4eb6-b5ad-cd1b1ff1bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.531776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b537a1-c574-4eb6-b5ad-cd1b1ff1bde7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.539913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-147c1199-7496-4af6-aed5-a6845ed85230 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 16 09:15:10.541154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 413/811] 10.222.0.90 () {56 vars in 1150 bytes} [Wed Feb 16 09:15:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:10.552358 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c1199-7496-4af6-aed5-a6845ed85230 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:10.564430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b537a1-c574-4eb6-b5ad-cd1b1ff1bde7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:10.571239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-78b537a1-c574-4eb6-b5ad-cd1b1ff1bde7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:15:10.574115 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 399/812] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:10.576290 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c1199-7496-4af6-aed5-a6845ed85230 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:10.579619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b537a1-c574-4eb6-b5ad-cd1b1ff1bde7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:10.587098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d9dd-acd5-41a2-8d00-72f01d0e3e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:10.587756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d9dd-acd5-41a2-8d00-72f01d0e3e50 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.588066 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d9dd-acd5-41a2-8d00-72f01d0e3e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.588323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5d9dd-acd5-41a2-8d00-72f01d0e3e50 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.589029 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5d9dd-acd5-41a2-8d00-72f01d0e3e50 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:10.589329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5d9dd-acd5-41a2-8d00-72f01d0e3e50 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:10.590921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5d9dd-acd5-41a2-8d00-72f01d0e3e50 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:10.598277 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 414/813] 10.222.0.90 () {56 vars in 1145 bytes} [Wed Feb 16 09:15:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:10.598520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b537a1-c574-4eb6-b5ad-cd1b1ff1bde7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:10.603731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d9dd-acd5-41a2-8d00-72f01d0e3e50 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:10.610517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b72df-db3d-4bd7-8c98-b01d269c6c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:10.611192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b72df-db3d-4bd7-8c98-b01d269c6c37 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.611478 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b72df-db3d-4bd7-8c98-b01d269c6c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.611755 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b72df-db3d-4bd7-8c98-b01d269c6c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.612639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b72df-db3d-4bd7-8c98-b01d269c6c37 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:10.612930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b72df-db3d-4bd7-8c98-b01d269c6c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:10.614540 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b72df-db3d-4bd7-8c98-b01d269c6c37 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:10.615436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5d9dd-acd5-41a2-8d00-72f01d0e3e50 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:10.620133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29326d10-b760-4f98-b2e8-cfb43af9fe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:10.621000 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29326d10-b760-4f98-b2e8-cfb43af9fe37 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.621465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29326d10-b760-4f98-b2e8-cfb43af9fe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.621930 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29326d10-b760-4f98-b2e8-cfb43af9fe37 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.622806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29326d10-b760-4f98-b2e8-cfb43af9fe37 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:10.623287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29326d10-b760-4f98-b2e8-cfb43af9fe37 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:10.625647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29326d10-b760-4f98-b2e8-cfb43af9fe37 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:10.636047 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 400/815] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:15:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:10.636232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 415/815] 10.222.0.90 () {56 vars in 1145 bytes} [Wed Feb 16 09:15:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:10.638031 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b72df-db3d-4bd7-8c98-b01d269c6c37 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:10.642958 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29326d10-b760-4f98-b2e8-cfb43af9fe37 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:10.653520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29326d10-b760-4f98-b2e8-cfb43af9fe37 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:10.653655 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b72df-db3d-4bd7-8c98-b01d269c6c37 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:10.658604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624511b4-daa9-42cc-b7d7-697a0f7e5c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:10.659532 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624511b4-daa9-42cc-b7d7-697a0f7e5c47 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.660120 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624511b4-daa9-42cc-b7d7-697a0f7e5c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.660594 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624511b4-daa9-42cc-b7d7-697a0f7e5c47 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.661607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624511b4-daa9-42cc-b7d7-697a0f7e5c47 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:10.662880 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-624511b4-daa9-42cc-b7d7-697a0f7e5c47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:15:10.662880 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:15:10.662880 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:15:10.664165 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624511b4-daa9-42cc-b7d7-697a0f7e5c47 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:10.676897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a9b59-b9f5-4a58-bdbc-3f8570893f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:10.677894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a9b59-b9f5-4a58-bdbc-3f8570893f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.678186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a9b59-b9f5-4a58-bdbc-3f8570893f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.678501 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a9b59-b9f5-4a58-bdbc-3f8570893f75 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.691731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 416/816] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Feb 16 09:15:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:15:10.705909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a9b59-b9f5-4a58-bdbc-3f8570893f75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:10.708426 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a9b59-b9f5-4a58-bdbc-3f8570893f75 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:10.731019 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-3e1a9b59-b9f5-4a58-bdbc-3f8570893f75 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:10.732986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 401/817] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:10.739249 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624511b4-daa9-42cc-b7d7-697a0f7e5c47 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:10.768450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624511b4-daa9-42cc-b7d7-697a0f7e5c47 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:10.773344 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b76ea-a92d-445a-9934-3b62689f1ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:10.774272 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b76ea-a92d-445a-9934-3b62689f1ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.774756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b76ea-a92d-445a-9934-3b62689f1ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.775251 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b76ea-a92d-445a-9934-3b62689f1ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.776223 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b76ea-a92d-445a-9934-3b62689f1ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:10.776732 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b76ea-a92d-445a-9934-3b62689f1ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:10.778669 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b76ea-a92d-445a-9934-3b62689f1ea3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:10.791717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 417/818] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:10.797891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a9b59-b9f5-4a58-bdbc-3f8570893f75 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:10.808507 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a9b59-b9f5-4a58-bdbc-3f8570893f75 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:10.814350 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044dad6-1469-43b2-88d2-814329f58fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:10.815543 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044dad6-1469-43b2-88d2-814329f58fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.816052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044dad6-1469-43b2-88d2-814329f58fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.816540 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044dad6-1469-43b2-88d2-814329f58fcd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.831255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044dad6-1469-43b2-88d2-814329f58fcd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:10.835254 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044dad6-1469-43b2-88d2-814329f58fcd admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:10.863307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-d044dad6-1469-43b2-88d2-814329f58fcd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 09:15:10.865625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 402/819] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:10.873202 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b76ea-a92d-445a-9934-3b62689f1ea3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:10.889702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b76ea-a92d-445a-9934-3b62689f1ea3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:10.896139 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eda79-0d75-4337-a224-1577790e2fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:10.897837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eda79-0d75-4337-a224-1577790e2fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.898612 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eda79-0d75-4337-a224-1577790e2fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.899474 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eda79-0d75-4337-a224-1577790e2fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.901529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eda79-0d75-4337-a224-1577790e2fd3 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:10.902179 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eda79-0d75-4337-a224-1577790e2fd3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:10.904438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eda79-0d75-4337-a224-1577790e2fd3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:10.933734 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 418/820] 10.222.0.90 () {56 vars in 1156 bytes} [Wed Feb 16 09:15:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:10.940200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044dad6-1469-43b2-88d2-814329f58fcd admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:10.954222 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044dad6-1469-43b2-88d2-814329f58fcd admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:10.959207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e3379-8e88-4106-ba87-b00d5803ed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:10.960316 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e3379-8e88-4106-ba87-b00d5803ed7d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:10.960800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e3379-8e88-4106-ba87-b00d5803ed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:10.961306 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e3379-8e88-4106-ba87-b00d5803ed7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:10.978335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e3379-8e88-4106-ba87-b00d5803ed7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:10.980582 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e3379-8e88-4106-ba87-b00d5803ed7d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:11.005194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-a36e3379-8e88-4106-ba87-b00d5803ed7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:11.006803 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 403/821] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:11.012392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eda79-0d75-4337-a224-1577790e2fd3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:11.024812 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eda79-0d75-4337-a224-1577790e2fd3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:11.029779 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa992122-146c-4922-8642-8de69420e939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:11.031392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992122-146c-4922-8642-8de69420e939 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.031914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992122-146c-4922-8642-8de69420e939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.032408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992122-146c-4922-8642-8de69420e939 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.033392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa992122-146c-4922-8642-8de69420e939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:11.033934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa992122-146c-4922-8642-8de69420e939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:11.035935 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa992122-146c-4922-8642-8de69420e939 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:11.053219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 419/822] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:11.058463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e3379-8e88-4106-ba87-b00d5803ed7d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:11.070832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e3379-8e88-4106-ba87-b00d5803ed7d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:11.076182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a87eb1-cd4b-46df-8e11-1682b3198f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:11.077530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a87eb1-cd4b-46df-8e11-1682b3198f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.078271 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a87eb1-cd4b-46df-8e11-1682b3198f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.078794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a87eb1-cd4b-46df-8e11-1682b3198f68 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.088011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a87eb1-cd4b-46df-8e11-1682b3198f68 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:11.093384 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a87eb1-cd4b-46df-8e11-1682b3198f68 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:11.100078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7223b-bdb3-49c1-bc77-bb4b334894ee None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.100381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7223b-bdb3-49c1-bc77-bb4b334894ee None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.100631 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7223b-bdb3-49c1-bc77-bb4b334894ee None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.102447 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 420/823] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:15:11.108057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea01bd-3739-4334-94a8-aad04a4fd2f4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.109050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea01bd-3739-4334-94a8-aad04a4fd2f4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.109327 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea01bd-3739-4334-94a8-aad04a4fd2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.111925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-e6a87eb1-cd4b-46df-8e11-1682b3198f68 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:11.113896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 404/824] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:11.119975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a87eb1-cd4b-46df-8e11-1682b3198f68 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:11.131040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c7ea01bd-3739-4334-94a8-aad04a4fd2f4 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:11.132316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c7ea01bd-3739-4334-94a8-aad04a4fd2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:11.133862 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a87eb1-cd4b-46df-8e11-1682b3198f68 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:11.139224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834fe8-0bec-4ce5-98b9-d09a8d971b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:11.141278 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834fe8-0bec-4ce5-98b9-d09a8d971b0f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.141395 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 421/825] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:11 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:11.141857 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834fe8-0bec-4ce5-98b9-d09a8d971b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.142303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e834fe8-0bec-4ce5-98b9-d09a8d971b0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.143250 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e834fe8-0bec-4ce5-98b9-d09a8d971b0f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:11.143816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e834fe8-0bec-4ce5-98b9-d09a8d971b0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:11.145851 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e834fe8-0bec-4ce5-98b9-d09a8d971b0f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:11.159974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 405/826] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:11.165553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea01bd-3739-4334-94a8-aad04a4fd2f4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:11.168156 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834fe8-0bec-4ce5-98b9-d09a8d971b0f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:11.177208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea01bd-3739-4334-94a8-aad04a4fd2f4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:11.179785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e834fe8-0bec-4ce5-98b9-d09a8d971b0f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:11.181868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72693bc-28c8-4373-b3ae-5e46ce85140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:11.182840 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72693bc-28c8-4373-b3ae-5e46ce85140c admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.183161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72693bc-28c8-4373-b3ae-5e46ce85140c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.183503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72693bc-28c8-4373-b3ae-5e46ce85140c admin admin] PATH_INFO: `/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/faf1f200fb2b4a2fb75b971054885eef/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.185596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72693bc-28c8-4373-b3ae-5e46ce85140c admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ab51e6e2745658b252fbafdc2f8ef, user_id=faf1f200fb2b4a2fb75b971054885eef, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:11.186172 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedd161-564f-4dc5-bd91-8c59e2a9051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:11.188163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd161-564f-4dc5-bd91-8c59e2a9051b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.188644 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd161-564f-4dc5-bd91-8c59e2a9051b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.189157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd161-564f-4dc5-bd91-8c59e2a9051b admin admin] PATH_INFO: `/v3/services/network` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.189992 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedd161-564f-4dc5-bd91-8c59e2a9051b admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:11.190441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72693bc-28c8-4373-b3ae-5e46ce85140c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:11.191949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedd161-564f-4dc5-bd91-8c59e2a9051b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:11.206892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-7bedd161-564f-4dc5-bd91-8c59e2a9051b admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 16 09:15:11.208711 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 422/827] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:15:11 2022] PUT /identity/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/faf1f200fb2b4a2fb75b971054885eef/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:15:11.208905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 406/828] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:11 2022] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:11.215412 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72693bc-28c8-4373-b3ae-5e46ce85140c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:11.285895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72693bc-28c8-4373-b3ae-5e46ce85140c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:11.290875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e588e42-4d08-4951-9419-7c29d9461de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:11.291546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e588e42-4d08-4951-9419-7c29d9461de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.291821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e588e42-4d08-4951-9419-7c29d9461de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.292116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e588e42-4d08-4951-9419-7c29d9461de4 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.292830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e588e42-4d08-4951-9419-7c29d9461de4 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:11.293131 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e588e42-4d08-4951-9419-7c29d9461de4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:11.294874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e588e42-4d08-4951-9419-7c29d9461de4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:11.300846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 423/829] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:11.306532 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedd161-564f-4dc5-bd91-8c59e2a9051b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:11.317943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedd161-564f-4dc5-bd91-8c59e2a9051b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:11.322989 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749771e2-981c-4f65-923a-48bc0ca6e458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:11.323587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749771e2-981c-4f65-923a-48bc0ca6e458 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.323863 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749771e2-981c-4f65-923a-48bc0ca6e458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.324221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749771e2-981c-4f65-923a-48bc0ca6e458 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.324929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749771e2-981c-4f65-923a-48bc0ca6e458 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:11.325282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749771e2-981c-4f65-923a-48bc0ca6e458 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:11.327354 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749771e2-981c-4f65-923a-48bc0ca6e458 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:11.333190 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 407/830] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:11.339048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e588e42-4d08-4951-9419-7c29d9461de4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:11.351052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e588e42-4d08-4951-9419-7c29d9461de4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:11.355988 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedf59f-b301-4ea8-8c74-73814b984017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:11.356731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedf59f-b301-4ea8-8c74-73814b984017 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.357006 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedf59f-b301-4ea8-8c74-73814b984017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.357276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedf59f-b301-4ea8-8c74-73814b984017 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.358059 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedf59f-b301-4ea8-8c74-73814b984017 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:11.360491 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedf59f-b301-4ea8-8c74-73814b984017 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:11.409903 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 424/831] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Feb 16 09:15:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:15:11.594791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180f06c-1334-41a1-9c80-b15835a6938e None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.594969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180f06c-1334-41a1-9c80-b15835a6938e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.595256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180f06c-1334-41a1-9c80-b15835a6938e None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.597506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 408/832] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:15:11.603161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c200f2-ddc0-465d-b1eb-7348ab9dbaff None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.603451 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c200f2-ddc0-465d-b1eb-7348ab9dbaff None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.603728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c200f2-ddc0-465d-b1eb-7348ab9dbaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.629125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-16c200f2-ddc0-465d-b1eb-7348ab9dbaff None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:11.630332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-16c200f2-ddc0-465d-b1eb-7348ab9dbaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:11.660523 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 425/833] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:11 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:11.688945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180f06c-1334-41a1-9c80-b15835a6938e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:11.703734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180f06c-1334-41a1-9c80-b15835a6938e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:11.710625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418a0f4-f669-4055-94d7-8c6dbc5f1cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:11.711683 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418a0f4-f669-4055-94d7-8c6dbc5f1cda admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.712279 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418a0f4-f669-4055-94d7-8c6dbc5f1cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.712765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418a0f4-f669-4055-94d7-8c6dbc5f1cda admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.713672 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418a0f4-f669-4055-94d7-8c6dbc5f1cda admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:11.715472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418a0f4-f669-4055-94d7-8c6dbc5f1cda admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:11.728524 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-b418a0f4-f669-4055-94d7-8c6dbc5f1cda admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 16 09:15:11.736770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 409/834] 10.222.0.90 () {56 vars in 1153 bytes} [Wed Feb 16 09:15:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:11.737557 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c200f2-ddc0-465d-b1eb-7348ab9dbaff None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:11.754592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c200f2-ddc0-465d-b1eb-7348ab9dbaff None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:11.764211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8fc50-0473-4aad-8fc7-d40ea7c53a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:11.765831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8fc50-0473-4aad-8fc7-d40ea7c53a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.766110 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8fc50-0473-4aad-8fc7-d40ea7c53a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.766487 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8fc50-0473-4aad-8fc7-d40ea7c53a42 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.767204 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8fc50-0473-4aad-8fc7-d40ea7c53a42 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:11.767504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8fc50-0473-4aad-8fc7-d40ea7c53a42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:11.769124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8fc50-0473-4aad-8fc7-d40ea7c53a42 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:11.774972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 426/835] 10.222.0.90 () {56 vars in 1147 bytes} [Wed Feb 16 09:15:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:11.781345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418a0f4-f669-4055-94d7-8c6dbc5f1cda admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:11.793187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418a0f4-f669-4055-94d7-8c6dbc5f1cda admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:11.798756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbc269-f626-4848-8caf-9fedc44740e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:11.799460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbc269-f626-4848-8caf-9fedc44740e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:11.799743 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbc269-f626-4848-8caf-9fedc44740e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:11.800015 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbc269-f626-4848-8caf-9fedc44740e6 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:11.800779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbc269-f626-4848-8caf-9fedc44740e6 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:11.801077 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbc269-f626-4848-8caf-9fedc44740e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:11.802721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbc269-f626-4848-8caf-9fedc44740e6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:11.808230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 410/836] 10.222.0.90 () {56 vars in 1147 bytes} [Wed Feb 16 09:15:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:12.349514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe97695-22b9-4df4-b03a-08099e5ed253 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.350045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe97695-22b9-4df4-b03a-08099e5ed253 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.350045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe97695-22b9-4df4-b03a-08099e5ed253 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.352087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 427/837] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:12.357358 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2dddc-b65d-4c44-9299-f895346bee7f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.357786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2dddc-b65d-4c44-9299-f895346bee7f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.357977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2dddc-b65d-4c44-9299-f895346bee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.376913 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-6be2dddc-b65d-4c44-9299-f895346bee7f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:12.378069 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6be2dddc-b65d-4c44-9299-f895346bee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:12.392124 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 411/838] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:12 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:12.411169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe97695-22b9-4df4-b03a-08099e5ed253 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:12.423614 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe97695-22b9-4df4-b03a-08099e5ed253 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:12.427788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57453801-1e22-42c8-925c-dbe2509ec216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:12.428576 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57453801-1e22-42c8-925c-dbe2509ec216 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.428850 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57453801-1e22-42c8-925c-dbe2509ec216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.429115 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57453801-1e22-42c8-925c-dbe2509ec216 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.439537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57453801-1e22-42c8-925c-dbe2509ec216 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:12.446337 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-57453801-1e22-42c8-925c-dbe2509ec216 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:15:12.452449 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 428/839] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:15:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:12.454192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2dddc-b65d-4c44-9299-f895346bee7f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:12.463228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2dddc-b65d-4c44-9299-f895346bee7f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:12.468551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88d66-d07f-4b2a-b91d-5bb410941f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:12.469378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88d66-d07f-4b2a-b91d-5bb410941f4a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.469662 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88d66-d07f-4b2a-b91d-5bb410941f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.469933 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab88d66-d07f-4b2a-b91d-5bb410941f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.470665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab88d66-d07f-4b2a-b91d-5bb410941f4a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:12.470966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab88d66-d07f-4b2a-b91d-5bb410941f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:12.472594 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab88d66-d07f-4b2a-b91d-5bb410941f4a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:12.485321 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 412/840] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:15:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:12.486600 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57453801-1e22-42c8-925c-dbe2509ec216 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:12.496086 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57453801-1e22-42c8-925c-dbe2509ec216 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:12.500992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0345-5916-455b-912f-d4d928434e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:12.501777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0345-5916-455b-912f-d4d928434e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.502060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0345-5916-455b-912f-d4d928434e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.502324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f0345-5916-455b-912f-d4d928434e71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.515105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f0345-5916-455b-912f-d4d928434e71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:12.517383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f0345-5916-455b-912f-d4d928434e71 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:12.534828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-063f0345-5916-455b-912f-d4d928434e71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:12.540107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 429/841] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:12.541954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88d66-d07f-4b2a-b91d-5bb410941f4a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:12.552315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab88d66-d07f-4b2a-b91d-5bb410941f4a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:12.556839 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06022c02-c6d4-431e-9d63-05148877805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:12.557482 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06022c02-c6d4-431e-9d63-05148877805b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.557761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06022c02-c6d4-431e-9d63-05148877805b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.558029 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06022c02-c6d4-431e-9d63-05148877805b admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.558739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06022c02-c6d4-431e-9d63-05148877805b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:12.559035 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06022c02-c6d4-431e-9d63-05148877805b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:12.560645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06022c02-c6d4-431e-9d63-05148877805b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:12.574062 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 413/842] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:12.579844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0345-5916-455b-912f-d4d928434e71 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:12.589859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f0345-5916-455b-912f-d4d928434e71 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:12.594982 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48522c08-996a-4599-bdd4-17d2b5c8775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:12.595785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48522c08-996a-4599-bdd4-17d2b5c8775a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.600191 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48522c08-996a-4599-bdd4-17d2b5c8775a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.600191 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48522c08-996a-4599-bdd4-17d2b5c8775a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.608672 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48522c08-996a-4599-bdd4-17d2b5c8775a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:12.611193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48522c08-996a-4599-bdd4-17d2b5c8775a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:12.626514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-48522c08-996a-4599-bdd4-17d2b5c8775a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 09:15:12.628271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 430/843] 10.222.0.90 () {56 vars in 1138 bytes} [Wed Feb 16 09:15:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:12.637376 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06022c02-c6d4-431e-9d63-05148877805b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:12.648423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06022c02-c6d4-431e-9d63-05148877805b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:12.653283 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715be91-d6a0-4fe6-81c5-0ad70e74b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:12.654115 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715be91-d6a0-4fe6-81c5-0ad70e74b514 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.654496 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715be91-d6a0-4fe6-81c5-0ad70e74b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.654911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715be91-d6a0-4fe6-81c5-0ad70e74b514 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.655972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715be91-d6a0-4fe6-81c5-0ad70e74b514 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:12.656544 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715be91-d6a0-4fe6-81c5-0ad70e74b514 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:12.658585 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715be91-d6a0-4fe6-81c5-0ad70e74b514 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:12.678318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 414/844] 10.222.0.90 () {56 vars in 1170 bytes} [Wed Feb 16 09:15:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:12.683974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48522c08-996a-4599-bdd4-17d2b5c8775a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:12.694966 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48522c08-996a-4599-bdd4-17d2b5c8775a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:12.699937 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e026055-5925-462d-8520-913d39ed583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:12.700631 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026055-5925-462d-8520-913d39ed583d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.700961 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026055-5925-462d-8520-913d39ed583d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.701244 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026055-5925-462d-8520-913d39ed583d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.711023 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e026055-5925-462d-8520-913d39ed583d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:12.712911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e026055-5925-462d-8520-913d39ed583d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:12.723755 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 431/845] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:12 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:15:12.729323 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715be91-d6a0-4fe6-81c5-0ad70e74b514 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:12.740105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715be91-d6a0-4fe6-81c5-0ad70e74b514 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:12.744719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dc223-380f-4a51-a87c-a9a29a67426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:12.745509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dc223-380f-4a51-a87c-a9a29a67426f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.745794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dc223-380f-4a51-a87c-a9a29a67426f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.746121 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dc223-380f-4a51-a87c-a9a29a67426f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.757138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dc223-380f-4a51-a87c-a9a29a67426f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:12.759029 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2dc223-380f-4a51-a87c-a9a29a67426f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:12.776715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-0f2dc223-380f-4a51-a87c-a9a29a67426f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:12.778210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 415/846] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:12.784589 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e026055-5925-462d-8520-913d39ed583d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:12.793645 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e026055-5925-462d-8520-913d39ed583d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:12.799036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25c6a8-e653-4dc9-9b7d-d349daa82b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:12.799677 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25c6a8-e653-4dc9-9b7d-d349daa82b87 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.799960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25c6a8-e653-4dc9-9b7d-d349daa82b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.800261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25c6a8-e653-4dc9-9b7d-d349daa82b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.800973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25c6a8-e653-4dc9-9b7d-d349daa82b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:12.801279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25c6a8-e653-4dc9-9b7d-d349daa82b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:12.802872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25c6a8-e653-4dc9-9b7d-d349daa82b87 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:12.815675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 432/847] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:12.821045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dc223-380f-4a51-a87c-a9a29a67426f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:12.831303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dc223-380f-4a51-a87c-a9a29a67426f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:12.835984 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a566e-c7c0-4011-a608-3bf36fc3878e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:12.836878 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a566e-c7c0-4011-a608-3bf36fc3878e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.837165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a566e-c7c0-4011-a608-3bf36fc3878e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.837443 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a566e-c7c0-4011-a608-3bf36fc3878e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.845345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a566e-c7c0-4011-a608-3bf36fc3878e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:12.847384 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a566e-c7c0-4011-a608-3bf36fc3878e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:12.861604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-513a566e-c7c0-4011-a608-3bf36fc3878e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:12.863044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 416/848] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:12.868651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25c6a8-e653-4dc9-9b7d-d349daa82b87 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:12.879211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25c6a8-e653-4dc9-9b7d-d349daa82b87 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:12.884033 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b36db7-4aee-467d-bd0f-550a446e6f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:12.884728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b36db7-4aee-467d-bd0f-550a446e6f85 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.885013 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b36db7-4aee-467d-bd0f-550a446e6f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.885344 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b36db7-4aee-467d-bd0f-550a446e6f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.886130 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b36db7-4aee-467d-bd0f-550a446e6f85 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:12.886497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b36db7-4aee-467d-bd0f-550a446e6f85 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:12.888424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b36db7-4aee-467d-bd0f-550a446e6f85 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:12.901848 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 433/849] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:12.907757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a566e-c7c0-4011-a608-3bf36fc3878e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:12.918703 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a566e-c7c0-4011-a608-3bf36fc3878e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:12.923563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6365688-4ae9-4d2d-8363-51e8215949bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:12.924346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6365688-4ae9-4d2d-8363-51e8215949bd admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:12.924644 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6365688-4ae9-4d2d-8363-51e8215949bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:12.924927 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6365688-4ae9-4d2d-8363-51e8215949bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:12.925805 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6365688-4ae9-4d2d-8363-51e8215949bd admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=ffcd409f87f84fe3bf25715e84c41af6) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:12.926118 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6365688-4ae9-4d2d-8363-51e8215949bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:12.928014 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6365688-4ae9-4d2d-8363-51e8215949bd admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:12.934888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 417/850] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:12 2022] GET /identity/v3/role_assignments?user.id=ffcd409f87f84fe3bf25715e84c41af6&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:13.457756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f4742-1a61-4a95-9e20-e186e02f240d None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:13.458461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f4742-1a61-4a95-9e20-e186e02f240d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:13.458461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f4742-1a61-4a95-9e20-e186e02f240d None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:13.460344 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 434/851] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:13.465597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a322e5-0075-4ad5-9f70-2026aec847ad None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:13.466083 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a322e5-0075-4ad5-9f70-2026aec847ad None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:13.466237 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a322e5-0075-4ad5-9f70-2026aec847ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:13.484230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-63a322e5-0075-4ad5-9f70-2026aec847ad None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:13.485408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-63a322e5-0075-4ad5-9f70-2026aec847ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:13.496121 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 418/852] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:13 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:13.518346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f4742-1a61-4a95-9e20-e186e02f240d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:13.530876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f4742-1a61-4a95-9e20-e186e02f240d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:13.535406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f84c6-6800-4e9d-a6b0-9d926c31de9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:13.536227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f84c6-6800-4e9d-a6b0-9d926c31de9d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:13.536520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f84c6-6800-4e9d-a6b0-9d926c31de9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:13.536819 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f84c6-6800-4e9d-a6b0-9d926c31de9d admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:13.537500 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f84c6-6800-4e9d-a6b0-9d926c31de9d admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:13.539138 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f84c6-6800-4e9d-a6b0-9d926c31de9d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:13.550896 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-135f84c6-6800-4e9d-a6b0-9d926c31de9d admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 16 09:15:13.556130 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 435/853] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:15:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:13.558515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a322e5-0075-4ad5-9f70-2026aec847ad None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:13.568467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a322e5-0075-4ad5-9f70-2026aec847ad None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:13.573180 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f016f4-5753-456e-b4ec-1c25cb37f422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:13.573832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f016f4-5753-456e-b4ec-1c25cb37f422 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:13.574128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f016f4-5753-456e-b4ec-1c25cb37f422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:13.574418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f016f4-5753-456e-b4ec-1c25cb37f422 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:13.575151 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f016f4-5753-456e-b4ec-1c25cb37f422 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:13.575472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f016f4-5753-456e-b4ec-1c25cb37f422 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:13.577928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f016f4-5753-456e-b4ec-1c25cb37f422 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:13.588349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 419/854] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:15:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:13.589871 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f84c6-6800-4e9d-a6b0-9d926c31de9d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:13.601301 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f84c6-6800-4e9d-a6b0-9d926c31de9d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:13.606227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abcae1-d8ed-4a7b-b407-9115c8e4b71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:13.606975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abcae1-d8ed-4a7b-b407-9115c8e4b71d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:13.607264 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abcae1-d8ed-4a7b-b407-9115c8e4b71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:13.607538 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abcae1-d8ed-4a7b-b407-9115c8e4b71d admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:13.609016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abcae1-d8ed-4a7b-b407-9115c8e4b71d admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:13.609534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abcae1-d8ed-4a7b-b407-9115c8e4b71d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:13.612134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abcae1-d8ed-4a7b-b407-9115c8e4b71d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:13.623648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 436/855] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:15:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:13.980848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3d2ed-5d10-4796-9c27-c6eb42fa030c None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:13.980848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3d2ed-5d10-4796-9c27-c6eb42fa030c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:13.980848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3d2ed-5d10-4796-9c27-c6eb42fa030c None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:13.980848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 420/856] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:13.989921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade9be7-75b9-4bcb-a828-84c657f72d00 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:13.989921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade9be7-75b9-4bcb-a828-84c657f72d00 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:13.989921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade9be7-75b9-4bcb-a828-84c657f72d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.007739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0ade9be7-75b9-4bcb-a828-84c657f72d00 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:14.009383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0ade9be7-75b9-4bcb-a828-84c657f72d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:14.023931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 437/857] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:13 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:14.048835 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3d2ed-5d10-4796-9c27-c6eb42fa030c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.061066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3d2ed-5d10-4796-9c27-c6eb42fa030c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.066538 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dca74-9b6f-4b4c-9993-c1a16e8a8a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.067308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dca74-9b6f-4b4c-9993-c1a16e8a8a8c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.067588 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dca74-9b6f-4b4c-9993-c1a16e8a8a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.067862 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dca74-9b6f-4b4c-9993-c1a16e8a8a8c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.078396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dca74-9b6f-4b4c-9993-c1a16e8a8a8c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:14.085358 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-7e3dca74-9b6f-4b4c-9993-c1a16e8a8a8c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:15:14.086896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 421/858] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:14.093174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade9be7-75b9-4bcb-a828-84c657f72d00 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.102789 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade9be7-75b9-4bcb-a828-84c657f72d00 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.107569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea990f12-cf5a-4f12-959b-9ff88a2fc927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.109100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea990f12-cf5a-4f12-959b-9ff88a2fc927 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.109585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea990f12-cf5a-4f12-959b-9ff88a2fc927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.110055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea990f12-cf5a-4f12-959b-9ff88a2fc927 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.111002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea990f12-cf5a-4f12-959b-9ff88a2fc927 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:14.111503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea990f12-cf5a-4f12-959b-9ff88a2fc927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:14.113326 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea990f12-cf5a-4f12-959b-9ff88a2fc927 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:14.122560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 438/859] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:15:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:14.128103 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dca74-9b6f-4b4c-9993-c1a16e8a8a8c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.138405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dca74-9b6f-4b4c-9993-c1a16e8a8a8c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.143795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51a745-d0ac-4cfb-a023-25eadc8114e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.144652 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51a745-d0ac-4cfb-a023-25eadc8114e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.144932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51a745-d0ac-4cfb-a023-25eadc8114e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.145204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51a745-d0ac-4cfb-a023-25eadc8114e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.157718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51a745-d0ac-4cfb-a023-25eadc8114e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:14.159612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51a745-d0ac-4cfb-a023-25eadc8114e0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:14.176957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-eb51a745-d0ac-4cfb-a023-25eadc8114e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:14.178634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 422/860] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:14.185453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea990f12-cf5a-4f12-959b-9ff88a2fc927 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.196498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea990f12-cf5a-4f12-959b-9ff88a2fc927 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.201103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c1816e-e8b7-4a42-adcd-baa442350a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.201754 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1816e-e8b7-4a42-adcd-baa442350a46 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.202499 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1816e-e8b7-4a42-adcd-baa442350a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.202979 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c1816e-e8b7-4a42-adcd-baa442350a46 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.203708 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1816e-e8b7-4a42-adcd-baa442350a46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:14.204015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1816e-e8b7-4a42-adcd-baa442350a46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:14.205656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c1816e-e8b7-4a42-adcd-baa442350a46 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:14.219183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 439/861] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:14.224742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51a745-d0ac-4cfb-a023-25eadc8114e0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.235717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51a745-d0ac-4cfb-a023-25eadc8114e0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.240421 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c691c5-8e75-41c9-96f1-bacdedf98ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.241253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c691c5-8e75-41c9-96f1-bacdedf98ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.241591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c691c5-8e75-41c9-96f1-bacdedf98ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.241870 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c691c5-8e75-41c9-96f1-bacdedf98ed8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.250191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c691c5-8e75-41c9-96f1-bacdedf98ed8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:14.252371 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c691c5-8e75-41c9-96f1-bacdedf98ed8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:14.257854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608f686-bea2-4e58-8a4a-e6d3221fac12 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.258375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608f686-bea2-4e58-8a4a-e6d3221fac12 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.258865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608f686-bea2-4e58-8a4a-e6d3221fac12 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.261098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 440/862] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:15:14.267344 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a5c03-8aa5-43ea-a3a9-63b3f7afd47a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.267875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a5c03-8aa5-43ea-a3a9-63b3f7afd47a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.268385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a5c03-8aa5-43ea-a3a9-63b3f7afd47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.269434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-31c691c5-8e75-41c9-96f1-bacdedf98ed8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 09:15:14.271079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 423/863] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:14.277331 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c691c5-8e75-41c9-96f1-bacdedf98ed8 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.288261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a35a5c03-8aa5-43ea-a3a9-63b3f7afd47a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:14.288555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c691c5-8e75-41c9-96f1-bacdedf98ed8 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.290168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a35a5c03-8aa5-43ea-a3a9-63b3f7afd47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:14.293136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219319fe-c0f5-41bf-ab74-2840000840f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.293786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219319fe-c0f5-41bf-ab74-2840000840f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.294066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219319fe-c0f5-41bf-ab74-2840000840f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.294337 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219319fe-c0f5-41bf-ab74-2840000840f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.295169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219319fe-c0f5-41bf-ab74-2840000840f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:14.295472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219319fe-c0f5-41bf-ab74-2840000840f4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:14.297938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219319fe-c0f5-41bf-ab74-2840000840f4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:14.300855 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 441/864] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:14 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:14.316677 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 424/865] 10.222.0.90 () {56 vars in 1156 bytes} [Wed Feb 16 09:15:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:14.322327 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a5c03-8aa5-43ea-a3a9-63b3f7afd47a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.332762 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219319fe-c0f5-41bf-ab74-2840000840f4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.334935 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a5c03-8aa5-43ea-a3a9-63b3f7afd47a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.340536 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb72e6b-00b3-4067-8c16-b9c1e437de15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.341347 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72e6b-00b3-4067-8c16-b9c1e437de15 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.341860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72e6b-00b3-4067-8c16-b9c1e437de15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.342281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb72e6b-00b3-4067-8c16-b9c1e437de15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.347253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219319fe-c0f5-41bf-ab74-2840000840f4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.351620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb72e6b-00b3-4067-8c16-b9c1e437de15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:14.352584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa56e0a-5d2d-46a7-8cbc-902700303449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.353506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa56e0a-5d2d-46a7-8cbc-902700303449 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.353885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa56e0a-5d2d-46a7-8cbc-902700303449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.354047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb72e6b-00b3-4067-8c16-b9c1e437de15 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:14.354391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa56e0a-5d2d-46a7-8cbc-902700303449 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.355216 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa56e0a-5d2d-46a7-8cbc-902700303449 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:14.357027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa56e0a-5d2d-46a7-8cbc-902700303449 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:14.368583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 442/866] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:14 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:15:14.369740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb72e6b-00b3-4067-8c16-b9c1e437de15 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.371485 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 425/867] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:15:14 2022] POST /identity/v3/services => generated 269 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:15:14.382255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb72e6b-00b3-4067-8c16-b9c1e437de15 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.400197 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dbe8e-4331-425e-a270-4f0b5814a937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.401336 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dbe8e-4331-425e-a270-4f0b5814a937 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.401843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dbe8e-4331-425e-a270-4f0b5814a937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.402268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dbe8e-4331-425e-a270-4f0b5814a937 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.415074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2dbe8e-4331-425e-a270-4f0b5814a937 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:14.417277 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2dbe8e-4331-425e-a270-4f0b5814a937 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:14.439986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-5c2dbe8e-4331-425e-a270-4f0b5814a937 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:14.441526 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 443/868] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:14.450011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa56e0a-5d2d-46a7-8cbc-902700303449 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.462116 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa56e0a-5d2d-46a7-8cbc-902700303449 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.467264 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9804837-3b47-4dbd-af52-6345aac26173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.469038 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9804837-3b47-4dbd-af52-6345aac26173 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.469495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9804837-3b47-4dbd-af52-6345aac26173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.469958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9804837-3b47-4dbd-af52-6345aac26173 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.470887 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9804837-3b47-4dbd-af52-6345aac26173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:14.471366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9804837-3b47-4dbd-af52-6345aac26173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:14.473503 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9804837-3b47-4dbd-af52-6345aac26173 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:14.488632 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 426/869] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:14.494817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dbe8e-4331-425e-a270-4f0b5814a937 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.507825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dbe8e-4331-425e-a270-4f0b5814a937 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.513406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6cea4-520b-4108-91d6-670d6a9db0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.515202 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6cea4-520b-4108-91d6-670d6a9db0af admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.515938 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6cea4-520b-4108-91d6-670d6a9db0af admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.516442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6cea4-520b-4108-91d6-670d6a9db0af admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.525203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6cea4-520b-4108-91d6-670d6a9db0af admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:14.527603 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6cea4-520b-4108-91d6-670d6a9db0af admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:14.543798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a0a6cea4-520b-4108-91d6-670d6a9db0af admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:14.546044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 444/870] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:14.552875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9804837-3b47-4dbd-af52-6345aac26173 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.564327 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9804837-3b47-4dbd-af52-6345aac26173 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.570738 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fd4d2-248f-413d-b08f-02797f6b7cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.571406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fd4d2-248f-413d-b08f-02797f6b7cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.571693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fd4d2-248f-413d-b08f-02797f6b7cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.571969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fd4d2-248f-413d-b08f-02797f6b7cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.572840 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fd4d2-248f-413d-b08f-02797f6b7cb3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:14.573153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fd4d2-248f-413d-b08f-02797f6b7cb3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:14.575140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fd4d2-248f-413d-b08f-02797f6b7cb3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:14.593799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 427/871] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:14.599973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6cea4-520b-4108-91d6-670d6a9db0af admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:14.611228 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6cea4-520b-4108-91d6-670d6a9db0af admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:14.616140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5494f4e-d7cc-497e-8b86-05e8277dc939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:14.616822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5494f4e-d7cc-497e-8b86-05e8277dc939 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:14.617162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5494f4e-d7cc-497e-8b86-05e8277dc939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:14.617453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5494f4e-d7cc-497e-8b86-05e8277dc939 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:14.618334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5494f4e-d7cc-497e-8b86-05e8277dc939 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=faf1f200fb2b4a2fb75b971054885eef) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:14.618647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5494f4e-d7cc-497e-8b86-05e8277dc939 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:14.620615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5494f4e-d7cc-497e-8b86-05e8277dc939 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:14.627986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 445/872] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:14 2022] GET /identity/v3/role_assignments?user.id=faf1f200fb2b4a2fb75b971054885eef&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=0e45946c6336419abb2015d8916e31ca => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:15.411695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77485a7-bb5d-4c88-9723-9a9138fd9ad1 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.412097 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77485a7-bb5d-4c88-9723-9a9138fd9ad1 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.412302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77485a7-bb5d-4c88-9723-9a9138fd9ad1 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.414311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 428/873] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:15.419858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ae0e-6518-460a-b5d9-62b369bae53b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.420181 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ae0e-6518-460a-b5d9-62b369bae53b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.420463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ae0e-6518-460a-b5d9-62b369bae53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.439189 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-edc8ae0e-6518-460a-b5d9-62b369bae53b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:15.440412 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-edc8ae0e-6518-460a-b5d9-62b369bae53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:15.448410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 446/874] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:15 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:15.473426 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77485a7-bb5d-4c88-9723-9a9138fd9ad1 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:15.486574 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77485a7-bb5d-4c88-9723-9a9138fd9ad1 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:15.491036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cea37-c8c4-4487-a3db-80ac82a01b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:15.491832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cea37-c8c4-4487-a3db-80ac82a01b75 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.492212 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cea37-c8c4-4487-a3db-80ac82a01b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.492490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cea37-c8c4-4487-a3db-80ac82a01b75 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.503896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cea37-c8c4-4487-a3db-80ac82a01b75 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:15.511346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-102cea37-c8c4-4487-a3db-80ac82a01b75 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 09:15:15.512914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 429/875] 10.222.0.90 () {56 vars in 1141 bytes} [Wed Feb 16 09:15:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:15.519016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8ae0e-6518-460a-b5d9-62b369bae53b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:15.528215 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8ae0e-6518-460a-b5d9-62b369bae53b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:15.533809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad846a-60fc-4485-9c6d-55003ae3a6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:15.534481 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad846a-60fc-4485-9c6d-55003ae3a6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.534766 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad846a-60fc-4485-9c6d-55003ae3a6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.535040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad846a-60fc-4485-9c6d-55003ae3a6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.535791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad846a-60fc-4485-9c6d-55003ae3a6b0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:15.536132 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad846a-60fc-4485-9c6d-55003ae3a6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:15.537743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad846a-60fc-4485-9c6d-55003ae3a6b0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:15.547669 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 447/876] 10.222.0.90 () {56 vars in 1136 bytes} [Wed Feb 16 09:15:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:15.553159 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cea37-c8c4-4487-a3db-80ac82a01b75 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:15.563276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cea37-c8c4-4487-a3db-80ac82a01b75 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:15.567894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45e32d-0057-4a2a-af5e-0f2e6f5bb587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:15.568699 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45e32d-0057-4a2a-af5e-0f2e6f5bb587 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.568982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45e32d-0057-4a2a-af5e-0f2e6f5bb587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.569319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45e32d-0057-4a2a-af5e-0f2e6f5bb587 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.585010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45e32d-0057-4a2a-af5e-0f2e6f5bb587 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:15.587167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45e32d-0057-4a2a-af5e-0f2e6f5bb587 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:15.605219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-8f45e32d-0057-4a2a-af5e-0f2e6f5bb587 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:15.607111 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 430/877] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:15.613013 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad846a-60fc-4485-9c6d-55003ae3a6b0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:15.623455 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad846a-60fc-4485-9c6d-55003ae3a6b0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:15.629000 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82700f3a-720b-4bb3-93b5-cc587c8ad545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:15.629682 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82700f3a-720b-4bb3-93b5-cc587c8ad545 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.629968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82700f3a-720b-4bb3-93b5-cc587c8ad545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.630246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82700f3a-720b-4bb3-93b5-cc587c8ad545 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.630999 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82700f3a-720b-4bb3-93b5-cc587c8ad545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:15.631298 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82700f3a-720b-4bb3-93b5-cc587c8ad545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:15.632984 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82700f3a-720b-4bb3-93b5-cc587c8ad545 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:15.648096 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 448/878] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:15.654063 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45e32d-0057-4a2a-af5e-0f2e6f5bb587 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:15.664748 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45e32d-0057-4a2a-af5e-0f2e6f5bb587 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:15.669500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69213-5708-418c-9af4-5f80d024fa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:15.670315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69213-5708-418c-9af4-5f80d024fa7f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.670776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69213-5708-418c-9af4-5f80d024fa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.671169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69213-5708-418c-9af4-5f80d024fa7f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.680537 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a69213-5708-418c-9af4-5f80d024fa7f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:15.682693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a69213-5708-418c-9af4-5f80d024fa7f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:15.698769 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-22a69213-5708-418c-9af4-5f80d024fa7f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 09:15:15.700303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 431/879] 10.222.0.90 () {56 vars in 1138 bytes} [Wed Feb 16 09:15:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:15.706623 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82700f3a-720b-4bb3-93b5-cc587c8ad545 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:15.716415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82700f3a-720b-4bb3-93b5-cc587c8ad545 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:15.721015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8e3fb-f97b-4bcb-894d-c01a37601be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:15.721676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8e3fb-f97b-4bcb-894d-c01a37601be8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.721960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8e3fb-f97b-4bcb-894d-c01a37601be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.722237 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8e3fb-f97b-4bcb-894d-c01a37601be8 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.723093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8e3fb-f97b-4bcb-894d-c01a37601be8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:15.723381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8e3fb-f97b-4bcb-894d-c01a37601be8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:15.725248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8e3fb-f97b-4bcb-894d-c01a37601be8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:15.743840 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 449/880] 10.222.0.90 () {56 vars in 1170 bytes} [Wed Feb 16 09:15:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:15.750237 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69213-5708-418c-9af4-5f80d024fa7f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:15.760096 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69213-5708-418c-9af4-5f80d024fa7f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:15.765646 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac5d2-40f5-4ca7-9dd4-18aa1161e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:15.766274 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac5d2-40f5-4ca7-9dd4-18aa1161e021 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.766566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac5d2-40f5-4ca7-9dd4-18aa1161e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.766841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ac5d2-40f5-4ca7-9dd4-18aa1161e021 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.774882 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ac5d2-40f5-4ca7-9dd4-18aa1161e021 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:15.776686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ac5d2-40f5-4ca7-9dd4-18aa1161e021 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:15.786539 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 432/881] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:15 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:15:15.792097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8e3fb-f97b-4bcb-894d-c01a37601be8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:15.802331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8e3fb-f97b-4bcb-894d-c01a37601be8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:15.806925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd651a85-3cc4-4520-908b-0e04ff66c1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:15.807700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd651a85-3cc4-4520-908b-0e04ff66c1cb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.807980 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd651a85-3cc4-4520-908b-0e04ff66c1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.808288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd651a85-3cc4-4520-908b-0e04ff66c1cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.819303 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd651a85-3cc4-4520-908b-0e04ff66c1cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:15.821294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd651a85-3cc4-4520-908b-0e04ff66c1cb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:15.839308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-fd651a85-3cc4-4520-908b-0e04ff66c1cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:15.840906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 450/882] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:15.847139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac5d2-40f5-4ca7-9dd4-18aa1161e021 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:15.856261 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ac5d2-40f5-4ca7-9dd4-18aa1161e021 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:15.861629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c692b5-9e1e-477a-adc1-7665405d63ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:15.862293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c692b5-9e1e-477a-adc1-7665405d63ba admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.862577 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c692b5-9e1e-477a-adc1-7665405d63ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.862855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c692b5-9e1e-477a-adc1-7665405d63ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.863631 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c692b5-9e1e-477a-adc1-7665405d63ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:15.863941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c692b5-9e1e-477a-adc1-7665405d63ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:15.865621 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c692b5-9e1e-477a-adc1-7665405d63ba admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:15.880910 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 433/883] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:15.886678 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd651a85-3cc4-4520-908b-0e04ff66c1cb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:15.898263 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd651a85-3cc4-4520-908b-0e04ff66c1cb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:15.903341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901061a5-13a4-4efb-9165-9d1b046bc180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:15.904263 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901061a5-13a4-4efb-9165-9d1b046bc180 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.904556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901061a5-13a4-4efb-9165-9d1b046bc180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.904832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901061a5-13a4-4efb-9165-9d1b046bc180 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.912457 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901061a5-13a4-4efb-9165-9d1b046bc180 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:15.914463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901061a5-13a4-4efb-9165-9d1b046bc180 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:15.927995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-901061a5-13a4-4efb-9165-9d1b046bc180 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:15.929473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 451/884] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:15.935208 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c692b5-9e1e-477a-adc1-7665405d63ba admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:15.946061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c692b5-9e1e-477a-adc1-7665405d63ba admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:15.950815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80435672-3c9d-4b0d-abe5-6db1c9cd26ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:15.951518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80435672-3c9d-4b0d-abe5-6db1c9cd26ee admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.951894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80435672-3c9d-4b0d-abe5-6db1c9cd26ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.952890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80435672-3c9d-4b0d-abe5-6db1c9cd26ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.953791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80435672-3c9d-4b0d-abe5-6db1c9cd26ee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:15.954102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80435672-3c9d-4b0d-abe5-6db1c9cd26ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:15.955995 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80435672-3c9d-4b0d-abe5-6db1c9cd26ee admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:15.968796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 434/885] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:15.974943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901061a5-13a4-4efb-9165-9d1b046bc180 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:15.986828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901061a5-13a4-4efb-9165-9d1b046bc180 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:15.991490 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b359e-c013-436d-bf4a-c33d0f36d246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:15.992221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b359e-c013-436d-bf4a-c33d0f36d246 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.992558 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b359e-c013-436d-bf4a-c33d0f36d246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.992839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b359e-c013-436d-bf4a-c33d0f36d246 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.993976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b359e-c013-436d-bf4a-c33d0f36d246 admin admin] RBAC: Adding query filter params (role.id=6b4e412de235405e8eff8775eca34b6b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=ffcd409f87f84fe3bf25715e84c41af6) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:15.994473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b359e-c013-436d-bf4a-c33d0f36d246 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:15.994855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e7ad-2960-483a-8c50-864b6f01b04a None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:15.995143 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e7ad-2960-483a-8c50-864b6f01b04a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:15.995415 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42e7ad-2960-483a-8c50-864b6f01b04a None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:15.996585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b359e-c013-436d-bf4a-c33d0f36d246 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:15.998499 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 435/886] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:15:16.002824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45f8ad-3931-46fc-94a2-c3625af630b2 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:16.003142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45f8ad-3931-46fc-94a2-c3625af630b2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:16.003419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45f8ad-3931-46fc-94a2-c3625af630b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:16.003743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 452/887] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:15 2022] GET /identity/v3/role_assignments?user.id=ffcd409f87f84fe3bf25715e84c41af6&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=6b4e412de235405e8eff8775eca34b6b => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:16.040102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-4a45f8ad-3931-46fc-94a2-c3625af630b2 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:16.041618 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4a45f8ad-3931-46fc-94a2-c3625af630b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:16.056230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 436/888] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:16 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:16.074902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b359e-c013-436d-bf4a-c33d0f36d246 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:16.086194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b359e-c013-436d-bf4a-c33d0f36d246 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:16.091423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7497a0-d852-40d8-91aa-e1b3e271d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:16.092337 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7497a0-d852-40d8-91aa-e1b3e271d8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:16.093480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7497a0-d852-40d8-91aa-e1b3e271d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:16.093904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7497a0-d852-40d8-91aa-e1b3e271d8c8 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:16.094843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7497a0-d852-40d8-91aa-e1b3e271d8c8 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:16.096690 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7497a0-d852-40d8-91aa-e1b3e271d8c8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:16.120360 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 453/889] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:15:16 2022] POST /identity/v3/services => generated 251 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:15:16.938939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf2ea3-83c8-44a7-9579-b941a3888d97 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:16.939469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf2ea3-83c8-44a7-9579-b941a3888d97 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:16.939469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf2ea3-83c8-44a7-9579-b941a3888d97 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:16.941534 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 437/890] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:16.946997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc4d58-4422-4d84-8689-6ef65f67379c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:16.947426 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc4d58-4422-4d84-8689-6ef65f67379c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:16.947633 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc4d58-4422-4d84-8689-6ef65f67379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:16.966511 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-dfdc4d58-4422-4d84-8689-6ef65f67379c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:16.968944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-dfdc4d58-4422-4d84-8689-6ef65f67379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:16.987121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 454/891] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:16 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:17.011204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf2ea3-83c8-44a7-9579-b941a3888d97 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:17.022951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf2ea3-83c8-44a7-9579-b941a3888d97 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:17.027517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59453e99-ccbe-4141-be8a-ee9010006d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:17.028376 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59453e99-ccbe-4141-be8a-ee9010006d87 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:17.028656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59453e99-ccbe-4141-be8a-ee9010006d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:17.028930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59453e99-ccbe-4141-be8a-ee9010006d87 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:17.029580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59453e99-ccbe-4141-be8a-ee9010006d87 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:17.033475 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59453e99-ccbe-4141-be8a-ee9010006d87 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:17.043885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-59453e99-ccbe-4141-be8a-ee9010006d87 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 16 09:15:17.045435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 438/892] 10.222.0.90 () {56 vars in 1153 bytes} [Wed Feb 16 09:15:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:17.051654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc4d58-4422-4d84-8689-6ef65f67379c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:17.060747 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc4d58-4422-4d84-8689-6ef65f67379c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:17.068172 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744936f-6cf5-409f-b1cc-514ff935e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:17.068842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744936f-6cf5-409f-b1cc-514ff935e981 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:17.069123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744936f-6cf5-409f-b1cc-514ff935e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:17.069399 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744936f-6cf5-409f-b1cc-514ff935e981 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:17.070110 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744936f-6cf5-409f-b1cc-514ff935e981 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:17.070419 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744936f-6cf5-409f-b1cc-514ff935e981 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:17.072014 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744936f-6cf5-409f-b1cc-514ff935e981 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:17.077929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 455/893] 10.222.0.90 () {56 vars in 1147 bytes} [Wed Feb 16 09:15:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:17.083502 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59453e99-ccbe-4141-be8a-ee9010006d87 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:17.092906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657bfe9-cb6f-4592-816c-ae5839a36f46 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:17.093306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657bfe9-cb6f-4592-816c-ae5839a36f46 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:17.093558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59453e99-ccbe-4141-be8a-ee9010006d87 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:17.093905 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657bfe9-cb6f-4592-816c-ae5839a36f46 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:17.099889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 456/894] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:15:17.101084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1941f-3c20-4c3e-b168-dd013ee84013 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:17.101464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1941f-3c20-4c3e-b168-dd013ee84013 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:17.101745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1941f-3c20-4c3e-b168-dd013ee84013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:17.102089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252f153-c7bc-414b-8f2e-a53681e656c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:17.102860 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252f153-c7bc-414b-8f2e-a53681e656c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:17.103209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252f153-c7bc-414b-8f2e-a53681e656c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:17.103554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252f153-c7bc-414b-8f2e-a53681e656c0 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:17.104410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252f153-c7bc-414b-8f2e-a53681e656c0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:17.104786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252f153-c7bc-414b-8f2e-a53681e656c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:17.106547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252f153-c7bc-414b-8f2e-a53681e656c0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:17.117214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 439/895] 10.222.0.90 () {56 vars in 1147 bytes} [Wed Feb 16 09:15:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:17.119652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7fc1941f-3c20-4c3e-b168-dd013ee84013 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:17.120873 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7fc1941f-3c20-4c3e-b168-dd013ee84013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:17.123376 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252f153-c7bc-414b-8f2e-a53681e656c0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:17.129694 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 457/896] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:17 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:17.141227 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252f153-c7bc-414b-8f2e-a53681e656c0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:17.145972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4c4ff-5972-41e7-a799-a1ecee0fc087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:17.146672 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4c4ff-5972-41e7-a799-a1ecee0fc087 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:17.146959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4c4ff-5972-41e7-a799-a1ecee0fc087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:17.147235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4c4ff-5972-41e7-a799-a1ecee0fc087 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:17.148124 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4c4ff-5972-41e7-a799-a1ecee0fc087 admin admin] RBAC: Adding query filter params (interface=public, service_id=4743183f711f4d2c94e3af89ea219cb4, region_id=RegionOne) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:17.148442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4c4ff-5972-41e7-a799-a1ecee0fc087 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:17.150079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4c4ff-5972-41e7-a799-a1ecee0fc087 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:17.154749 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1941f-3c20-4c3e-b168-dd013ee84013 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:17.158313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 440/897] 10.222.0.90 () {56 vars in 1272 bytes} [Wed Feb 16 09:15:17 2022] GET /identity/v3/endpoints?service_id=4743183f711f4d2c94e3af89ea219cb4&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:17.163929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4c4ff-5972-41e7-a799-a1ecee0fc087 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:17.165393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1941f-3c20-4c3e-b168-dd013ee84013 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:17.170546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7cf44-bc33-49ae-b44a-5db099c57adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:17.171982 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7cf44-bc33-49ae-b44a-5db099c57adf admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:17.172301 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7cf44-bc33-49ae-b44a-5db099c57adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:17.172583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7cf44-bc33-49ae-b44a-5db099c57adf admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:17.173304 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7cf44-bc33-49ae-b44a-5db099c57adf admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:17.174985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7cf44-bc33-49ae-b44a-5db099c57adf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:17.176255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4c4ff-5972-41e7-a799-a1ecee0fc087 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:17.180825 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317e798-6117-4cdf-9e11-88fba09af378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:17.181591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317e798-6117-4cdf-9e11-88fba09af378 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:17.181869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317e798-6117-4cdf-9e11-88fba09af378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:17.182140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317e798-6117-4cdf-9e11-88fba09af378 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:17.182868 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317e798-6117-4cdf-9e11-88fba09af378 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:17.184518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317e798-6117-4cdf-9e11-88fba09af378 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:17.187879 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-48e7cf44-bc33-49ae-b44a-5db099c57adf admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 09:15:17.189479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 458/898] 10.222.0.90 () {56 vars in 1147 bytes} [Wed Feb 16 09:15:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:17.194530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 441/899] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Feb 16 09:15:17 2022] GET /identity/v3/services => generated 1268 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:15:17.194920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7cf44-bc33-49ae-b44a-5db099c57adf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:17.210618 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7cf44-bc33-49ae-b44a-5db099c57adf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:17.216091 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d24ec-a2bd-4598-880c-818917092a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:17.217207 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d24ec-a2bd-4598-880c-818917092a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:17.218276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d24ec-a2bd-4598-880c-818917092a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:17.218760 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d24ec-a2bd-4598-880c-818917092a6b admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:17.219821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d24ec-a2bd-4598-880c-818917092a6b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:17.220359 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d24ec-a2bd-4598-880c-818917092a6b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:17.222278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d24ec-a2bd-4598-880c-818917092a6b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:17.228425 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 459/900] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Feb 16 09:15:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:17.237511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317e798-6117-4cdf-9e11-88fba09af378 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:17.248149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317e798-6117-4cdf-9e11-88fba09af378 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:17.253600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3f12f-2345-4deb-9d4a-3c06fd1c0662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:17.254277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3f12f-2345-4deb-9d4a-3c06fd1c0662 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:17.254609 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3f12f-2345-4deb-9d4a-3c06fd1c0662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:17.254886 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3f12f-2345-4deb-9d4a-3c06fd1c0662 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:17.255651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3f12f-2345-4deb-9d4a-3c06fd1c0662 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:17.255960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3f12f-2345-4deb-9d4a-3c06fd1c0662 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:17.257700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3f12f-2345-4deb-9d4a-3c06fd1c0662 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:17.263587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 442/901] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Feb 16 09:15:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:18.381869 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bde7a1-2b5b-4402-9fb3-69134f47938c None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.382415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bde7a1-2b5b-4402-9fb3-69134f47938c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.382415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bde7a1-2b5b-4402-9fb3-69134f47938c None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.384516 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 460/902] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:18.391246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce18d8-b617-435b-b73b-8089f77d3492 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.391788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce18d8-b617-435b-b73b-8089f77d3492 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.391788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce18d8-b617-435b-b73b-8089f77d3492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.411157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-22ce18d8-b617-435b-b73b-8089f77d3492 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:18.412405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-22ce18d8-b617-435b-b73b-8089f77d3492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:18.420634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 443/903] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:18 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:18.443140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bde7a1-2b5b-4402-9fb3-69134f47938c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.456486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bde7a1-2b5b-4402-9fb3-69134f47938c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.460831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dbb3b-7192-460c-8dc3-ae4b10722fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.461619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dbb3b-7192-460c-8dc3-ae4b10722fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.461897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dbb3b-7192-460c-8dc3-ae4b10722fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.462169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dbb3b-7192-460c-8dc3-ae4b10722fb9 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.473885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dbb3b-7192-460c-8dc3-ae4b10722fb9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:18.481065 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-802dbb3b-7192-460c-8dc3-ae4b10722fb9 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 09:15:18.482531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 461/904] 10.222.0.90 () {56 vars in 1141 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:18.488354 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce18d8-b617-435b-b73b-8089f77d3492 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.497677 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce18d8-b617-435b-b73b-8089f77d3492 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.502816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ec04f-d301-418c-bfaf-39c200b9b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.503511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ec04f-d301-418c-bfaf-39c200b9b3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.503797 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ec04f-d301-418c-bfaf-39c200b9b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.504102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ec04f-d301-418c-bfaf-39c200b9b3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.504873 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ec04f-d301-418c-bfaf-39c200b9b3b1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:18.505182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ec04f-d301-418c-bfaf-39c200b9b3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.506843 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ec04f-d301-418c-bfaf-39c200b9b3b1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.517647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 444/905] 10.222.0.90 () {56 vars in 1136 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:18.522851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dbb3b-7192-460c-8dc3-ae4b10722fb9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.533296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dbb3b-7192-460c-8dc3-ae4b10722fb9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.537815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd86586-e21d-46fd-ad7e-d636f9fc7240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.538723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd86586-e21d-46fd-ad7e-d636f9fc7240 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.539006 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd86586-e21d-46fd-ad7e-d636f9fc7240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.539278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd86586-e21d-46fd-ad7e-d636f9fc7240 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.552349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd86586-e21d-46fd-ad7e-d636f9fc7240 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.555769 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd86586-e21d-46fd-ad7e-d636f9fc7240 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.575310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-0cd86586-e21d-46fd-ad7e-d636f9fc7240 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:18.576853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 462/906] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:18.582828 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d95948-78ac-4774-932e-4d65ba939c4c None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.583118 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd86586-e21d-46fd-ad7e-d636f9fc7240 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.583400 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d95948-78ac-4774-932e-4d65ba939c4c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.583400 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d95948-78ac-4774-932e-4d65ba939c4c None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.586319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 445/907] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:18.591405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94ba06-e489-411c-88a6-01d645e4e5fa None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.591686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94ba06-e489-411c-88a6-01d645e4e5fa None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.591965 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94ba06-e489-411c-88a6-01d645e4e5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.593224 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd86586-e21d-46fd-ad7e-d636f9fc7240 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.597865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ace33-9c39-448a-9a31-64f14839bbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.598498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ace33-9c39-448a-9a31-64f14839bbaf admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.598777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ace33-9c39-448a-9a31-64f14839bbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.599049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ace33-9c39-448a-9a31-64f14839bbaf admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.599762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ace33-9c39-448a-9a31-64f14839bbaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:18.600092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ace33-9c39-448a-9a31-64f14839bbaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.601679 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ace33-9c39-448a-9a31-64f14839bbaf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.613016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-3f94ba06-e489-411c-88a6-01d645e4e5fa None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:18.614135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 463/908] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:18.614481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-3f94ba06-e489-411c-88a6-01d645e4e5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:18.619366 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ace33-9c39-448a-9a31-64f14839bbaf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.628144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 446/909] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:18 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:18.633002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ace33-9c39-448a-9a31-64f14839bbaf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.637482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573526d-473f-4bdb-849a-7213cd725976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.638252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573526d-473f-4bdb-849a-7213cd725976 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.638529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573526d-473f-4bdb-849a-7213cd725976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.638887 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573526d-473f-4bdb-849a-7213cd725976 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.647622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573526d-473f-4bdb-849a-7213cd725976 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.649765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573526d-473f-4bdb-849a-7213cd725976 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.650946 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94ba06-e489-411c-88a6-01d645e4e5fa None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.661221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94ba06-e489-411c-88a6-01d645e4e5fa None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.663542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-7573526d-473f-4bdb-849a-7213cd725976 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 09:15:18.664947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 464/910] 10.222.0.90 () {56 vars in 1138 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:18.666209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828facf-bab3-4574-bc90-1cb77f0e7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.667105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828facf-bab3-4574-bc90-1cb77f0e7936 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.667480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828facf-bab3-4574-bc90-1cb77f0e7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.667846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828facf-bab3-4574-bc90-1cb77f0e7936 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.668630 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828facf-bab3-4574-bc90-1cb77f0e7936 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.670250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573526d-473f-4bdb-849a-7213cd725976 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.670866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828facf-bab3-4574-bc90-1cb77f0e7936 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.679498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573526d-473f-4bdb-849a-7213cd725976 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.683859 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-7828facf-bab3-4574-bc90-1cb77f0e7936 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 16 09:15:18.684056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3873b25-8fb5-4c73-822b-973de4aa1b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.684552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3873b25-8fb5-4c73-822b-973de4aa1b34 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.684827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3873b25-8fb5-4c73-822b-973de4aa1b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.685098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3873b25-8fb5-4c73-822b-973de4aa1b34 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.685909 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3873b25-8fb5-4c73-822b-973de4aa1b34 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:18.686764 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3873b25-8fb5-4c73-822b-973de4aa1b34 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.688596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3873b25-8fb5-4c73-822b-973de4aa1b34 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.690271 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 447/911] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:18.692959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828facf-bab3-4574-bc90-1cb77f0e7936 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.704973 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828facf-bab3-4574-bc90-1cb77f0e7936 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.706546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 465/912] 10.222.0.90 () {56 vars in 1170 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:18.709957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c6534-ecd5-45d6-b08a-bf4984e4ed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.710735 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c6534-ecd5-45d6-b08a-bf4984e4ed2c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.711153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c6534-ecd5-45d6-b08a-bf4984e4ed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.711318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c6534-ecd5-45d6-b08a-bf4984e4ed2c admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.711912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3873b25-8fb5-4c73-822b-973de4aa1b34 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.712109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c6534-ecd5-45d6-b08a-bf4984e4ed2c admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:18.712351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c6534-ecd5-45d6-b08a-bf4984e4ed2c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.714016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c6534-ecd5-45d6-b08a-bf4984e4ed2c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.721817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3873b25-8fb5-4c73-822b-973de4aa1b34 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.724101 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 448/913] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:18.726335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c6534-ecd5-45d6-b08a-bf4984e4ed2c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.727904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec0889-ef0a-40b9-9a45-da77e6763df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.728812 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec0889-ef0a-40b9-9a45-da77e6763df7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.729156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec0889-ef0a-40b9-9a45-da77e6763df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.729494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec0889-ef0a-40b9-9a45-da77e6763df7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.737625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c6534-ecd5-45d6-b08a-bf4984e4ed2c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.740892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec0889-ef0a-40b9-9a45-da77e6763df7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.742817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec0889-ef0a-40b9-9a45-da77e6763df7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.742988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eeb2e-c53b-4704-933c-bc4b7d9f0879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.743801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eeb2e-c53b-4704-933c-bc4b7d9f0879 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.744158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eeb2e-c53b-4704-933c-bc4b7d9f0879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.744434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eeb2e-c53b-4704-933c-bc4b7d9f0879 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.745350 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eeb2e-c53b-4704-933c-bc4b7d9f0879 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:18.745972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eeb2e-c53b-4704-933c-bc4b7d9f0879 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.747585 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eeb2e-c53b-4704-933c-bc4b7d9f0879 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.758781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 449/914] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:18.759989 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eeb2e-c53b-4704-933c-bc4b7d9f0879 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.761038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-baec0889-ef0a-40b9-9a45-da77e6763df7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:18.762540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 466/915] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:18.768129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec0889-ef0a-40b9-9a45-da77e6763df7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.770403 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eeb2e-c53b-4704-933c-bc4b7d9f0879 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.776015 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffa5bb-df3f-4582-a66b-fc286ea73d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.776719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffa5bb-df3f-4582-a66b-fc286ea73d87 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.776994 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffa5bb-df3f-4582-a66b-fc286ea73d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.777263 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffa5bb-df3f-4582-a66b-fc286ea73d87 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.777737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec0889-ef0a-40b9-9a45-da77e6763df7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.778079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffa5bb-df3f-4582-a66b-fc286ea73d87 admin admin] RBAC: Adding query filter params (interface=public, service_id=e38b6a45ed40407f86a8bc5f28abfea8, region_id=RegionOne) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:18.778383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffa5bb-df3f-4582-a66b-fc286ea73d87 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.780891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffa5bb-df3f-4582-a66b-fc286ea73d87 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.783031 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a17b33-c8f3-4597-8b25-b0608744ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.783720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a17b33-c8f3-4597-8b25-b0608744ea6f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.784086 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a17b33-c8f3-4597-8b25-b0608744ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.784561 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a17b33-c8f3-4597-8b25-b0608744ea6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.785340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a17b33-c8f3-4597-8b25-b0608744ea6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:18.785711 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a17b33-c8f3-4597-8b25-b0608744ea6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.787332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a17b33-c8f3-4597-8b25-b0608744ea6f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.791026 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 450/916] 10.222.0.90 () {56 vars in 1272 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/endpoints?service_id=e38b6a45ed40407f86a8bc5f28abfea8&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:18.792736 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffa5bb-df3f-4582-a66b-fc286ea73d87 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.802052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 467/917] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:18.804414 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffa5bb-df3f-4582-a66b-fc286ea73d87 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.807312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a17b33-c8f3-4597-8b25-b0608744ea6f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.809239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637ac7a-2918-451d-9ce1-b3424cb1a942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.809870 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637ac7a-2918-451d-9ce1-b3424cb1a942 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.810197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637ac7a-2918-451d-9ce1-b3424cb1a942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.810470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637ac7a-2918-451d-9ce1-b3424cb1a942 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.811161 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637ac7a-2918-451d-9ce1-b3424cb1a942 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.813137 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637ac7a-2918-451d-9ce1-b3424cb1a942 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.817334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a17b33-c8f3-4597-8b25-b0608744ea6f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.824106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 451/918] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:15:18.829327 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e725c-782f-4140-b896-f244f29f2a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.830161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e725c-782f-4140-b896-f244f29f2a44 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.831318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e725c-782f-4140-b896-f244f29f2a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.831318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e725c-782f-4140-b896-f244f29f2a44 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.838717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e725c-782f-4140-b896-f244f29f2a44 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.842170 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e725c-782f-4140-b896-f244f29f2a44 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.858093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-2a9e725c-782f-4140-b896-f244f29f2a44 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:18.860489 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 468/919] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:18.866549 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637ac7a-2918-451d-9ce1-b3424cb1a942 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.877249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637ac7a-2918-451d-9ce1-b3424cb1a942 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.882494 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a8a66-1cf4-4b14-b804-914937ce2e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.883490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a8a66-1cf4-4b14-b804-914937ce2e1c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.883945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a8a66-1cf4-4b14-b804-914937ce2e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.884393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a8a66-1cf4-4b14-b804-914937ce2e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.885389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a8a66-1cf4-4b14-b804-914937ce2e1c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:18.885841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a8a66-1cf4-4b14-b804-914937ce2e1c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.887991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a8a66-1cf4-4b14-b804-914937ce2e1c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.902875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 452/920] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:18.909915 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e725c-782f-4140-b896-f244f29f2a44 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:18.920437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e725c-782f-4140-b896-f244f29f2a44 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:18.926388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45d0f5-81fc-42e3-aa5c-49ab3aee26e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:18.927535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45d0f5-81fc-42e3-aa5c-49ab3aee26e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:18.927994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45d0f5-81fc-42e3-aa5c-49ab3aee26e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:18.928490 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45d0f5-81fc-42e3-aa5c-49ab3aee26e0 admin admin] PATH_INFO: `/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/ffcd409f87f84fe3bf25715e84c41af6/roles/6b4e412de235405e8eff8775eca34b6b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:18.930978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45d0f5-81fc-42e3-aa5c-49ab3aee26e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ab51e6e2745658b252fbafdc2f8ef, user_id=ffcd409f87f84fe3bf25715e84c41af6, role_id=6b4e412de235405e8eff8775eca34b6b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:18.933965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45d0f5-81fc-42e3-aa5c-49ab3aee26e0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:18.952897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 469/921] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:15:18 2022] PUT /identity/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/ffcd409f87f84fe3bf25715e84c41af6/roles/6b4e412de235405e8eff8775eca34b6b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:15:19.651592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021197f9-5c68-4ea8-8c84-38b7a087e1a6 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:19.652495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021197f9-5c68-4ea8-8c84-38b7a087e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:19.652910 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021197f9-5c68-4ea8-8c84-38b7a087e1a6 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:19.654814 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 453/922] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:19.660693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc7027-8afd-4dcb-b876-9dc5a0a71ae2 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:19.661164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc7027-8afd-4dcb-b876-9dc5a0a71ae2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:19.661325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc7027-8afd-4dcb-b876-9dc5a0a71ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:19.679815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-64cc7027-8afd-4dcb-b876-9dc5a0a71ae2 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:19.681044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-64cc7027-8afd-4dcb-b876-9dc5a0a71ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:19.744114 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 470/923] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:19 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:19.762469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81021964-6e76-48f0-b656-b6206261dfe6 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:19.763073 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81021964-6e76-48f0-b656-b6206261dfe6 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:19.763541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81021964-6e76-48f0-b656-b6206261dfe6 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:19.766314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 454/924] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:19.771233 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc7027-8afd-4dcb-b876-9dc5a0a71ae2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:19.771903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccfea9-dfef-41c3-bfe4-83db6421a10f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:19.772401 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccfea9-dfef-41c3-bfe4-83db6421a10f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:19.772867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccfea9-dfef-41c3-bfe4-83db6421a10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:19.780743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc7027-8afd-4dcb-b876-9dc5a0a71ae2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:19.785322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c15de-80af-4e13-b16e-0e37ebb57b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:19.786129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c15de-80af-4e13-b16e-0e37ebb57b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:19.786410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c15de-80af-4e13-b16e-0e37ebb57b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:19.786685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c15de-80af-4e13-b16e-0e37ebb57b41 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:19.787343 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c15de-80af-4e13-b16e-0e37ebb57b41 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:19.789052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c15de-80af-4e13-b16e-0e37ebb57b41 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:19.796246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-83ccfea9-dfef-41c3-bfe4-83db6421a10f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:19.797899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-83ccfea9-dfef-41c3-bfe4-83db6421a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:19.801377 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-438c15de-80af-4e13-b16e-0e37ebb57b41 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 16 09:15:19.803030 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 471/925] 10.222.0.90 () {56 vars in 1153 bytes} [Wed Feb 16 09:15:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:19.806733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 455/926] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:19 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:19.812147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c15de-80af-4e13-b16e-0e37ebb57b41 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:19.821473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c15de-80af-4e13-b16e-0e37ebb57b41 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:19.825982 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb563b63-5a99-4c98-b2c7-14d52df35ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:19.826627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563b63-5a99-4c98-b2c7-14d52df35ebd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:19.827070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563b63-5a99-4c98-b2c7-14d52df35ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:19.827312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563b63-5a99-4c98-b2c7-14d52df35ebd admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:19.827960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb563b63-5a99-4c98-b2c7-14d52df35ebd admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:19.828299 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb563b63-5a99-4c98-b2c7-14d52df35ebd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:19.829998 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb563b63-5a99-4c98-b2c7-14d52df35ebd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:19.835809 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccfea9-dfef-41c3-bfe4-83db6421a10f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:19.839439 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 472/927] 10.222.0.90 () {56 vars in 1147 bytes} [Wed Feb 16 09:15:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:19.847207 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb563b63-5a99-4c98-b2c7-14d52df35ebd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:19.850066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccfea9-dfef-41c3-bfe4-83db6421a10f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:19.855848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fae7f0-bba6-44a5-a36b-5a3179c98587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:19.856813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fae7f0-bba6-44a5-a36b-5a3179c98587 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:19.857298 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fae7f0-bba6-44a5-a36b-5a3179c98587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:19.857770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fae7f0-bba6-44a5-a36b-5a3179c98587 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:19.859411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fae7f0-bba6-44a5-a36b-5a3179c98587 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:19.860801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb563b63-5a99-4c98-b2c7-14d52df35ebd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:19.861692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fae7f0-bba6-44a5-a36b-5a3179c98587 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:19.865303 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f4c8d-9725-4cd1-b0bc-d797cf8bfbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:19.866078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f4c8d-9725-4cd1-b0bc-d797cf8bfbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:19.866275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f4c8d-9725-4cd1-b0bc-d797cf8bfbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:19.866500 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f4c8d-9725-4cd1-b0bc-d797cf8bfbd0 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:19.867309 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f4c8d-9725-4cd1-b0bc-d797cf8bfbd0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:19.867715 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f4c8d-9725-4cd1-b0bc-d797cf8bfbd0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:19.869162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f4c8d-9725-4cd1-b0bc-d797cf8bfbd0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:19.875459 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 473/928] 10.222.0.90 () {56 vars in 1147 bytes} [Wed Feb 16 09:15:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:19.881377 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f4c8d-9725-4cd1-b0bc-d797cf8bfbd0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:19.884598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 456/929] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:15:19 2022] POST /identity/v3/services => generated 241 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:15:19.895394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f4c8d-9725-4cd1-b0bc-d797cf8bfbd0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:19.911072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3e813-f88f-4ba5-aa99-3e3d463e3e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:19.912196 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3e813-f88f-4ba5-aa99-3e3d463e3e9b admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:19.912700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3e813-f88f-4ba5-aa99-3e3d463e3e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:19.913234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3e813-f88f-4ba5-aa99-3e3d463e3e9b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:19.914190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3e813-f88f-4ba5-aa99-3e3d463e3e9b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:19.916075 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3e813-f88f-4ba5-aa99-3e3d463e3e9b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:19.944077 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 474/930] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Feb 16 09:15:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:15:21.246665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2083ec8-7adb-45d6-b1d4-8b1b4658358b None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.247211 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2083ec8-7adb-45d6-b1d4-8b1b4658358b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.247211 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2083ec8-7adb-45d6-b1d4-8b1b4658358b None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.249437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 457/931] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:21.255080 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e54c5-a7dd-42be-b4c8-a0b77ff2eba1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.255541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e54c5-a7dd-42be-b4c8-a0b77ff2eba1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.255618 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e54c5-a7dd-42be-b4c8-a0b77ff2eba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.274948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2a1e54c5-a7dd-42be-b4c8-a0b77ff2eba1 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:21.276054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2a1e54c5-a7dd-42be-b4c8-a0b77ff2eba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:21.297279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 475/932] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:21 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:21.318134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2083ec8-7adb-45d6-b1d4-8b1b4658358b None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.330747 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2083ec8-7adb-45d6-b1d4-8b1b4658358b None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.336272 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fa3d4-d041-4203-9306-8254c07b43d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.337050 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fa3d4-d041-4203-9306-8254c07b43d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.337328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fa3d4-d041-4203-9306-8254c07b43d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.337600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fa3d4-d041-4203-9306-8254c07b43d9 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.338237 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fa3d4-d041-4203-9306-8254c07b43d9 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.339819 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fa3d4-d041-4203-9306-8254c07b43d9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:21.351226 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-491fa3d4-d041-4203-9306-8254c07b43d9 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 16 09:15:21.356128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 458/933] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:21.359186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e54c5-a7dd-42be-b4c8-a0b77ff2eba1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.367975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e54c5-a7dd-42be-b4c8-a0b77ff2eba1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.373620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e579ea5-308d-4088-bd6a-a826cfd17df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.374818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e579ea5-308d-4088-bd6a-a826cfd17df6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.375149 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e579ea5-308d-4088-bd6a-a826cfd17df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.375421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e579ea5-308d-4088-bd6a-a826cfd17df6 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.376157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e579ea5-308d-4088-bd6a-a826cfd17df6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:21.376460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e579ea5-308d-4088-bd6a-a826cfd17df6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.378037 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e579ea5-308d-4088-bd6a-a826cfd17df6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:21.387533 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 476/934] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:21.388941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fa3d4-d041-4203-9306-8254c07b43d9 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.399090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fa3d4-d041-4203-9306-8254c07b43d9 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.403639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c26f6-c239-4fc9-8f41-ccbfd27959f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.404306 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c26f6-c239-4fc9-8f41-ccbfd27959f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.404582 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c26f6-c239-4fc9-8f41-ccbfd27959f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.404923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c26f6-c239-4fc9-8f41-ccbfd27959f5 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.405798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c26f6-c239-4fc9-8f41-ccbfd27959f5 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:21.406099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c26f6-c239-4fc9-8f41-ccbfd27959f5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.407739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c26f6-c239-4fc9-8f41-ccbfd27959f5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:21.417248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 459/935] 10.222.0.90 () {56 vars in 1135 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:21.418583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e579ea5-308d-4088-bd6a-a826cfd17df6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.425779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0530fca-ca24-47a9-974d-3caa14501ae7 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.425779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0530fca-ca24-47a9-974d-3caa14501ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.426151 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0530fca-ca24-47a9-974d-3caa14501ae7 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.427930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 460/936] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:15:21.429212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e579ea5-308d-4088-bd6a-a826cfd17df6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.432805 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6ff7-84c5-4373-ad10-a8c102ac3408 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.433091 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6ff7-84c5-4373-ad10-a8c102ac3408 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.433363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db6ff7-84c5-4373-ad10-a8c102ac3408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.433834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1ac6f-b699-4ba3-8b0b-f115dad37cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.434462 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1ac6f-b699-4ba3-8b0b-f115dad37cad admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.434736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1ac6f-b699-4ba3-8b0b-f115dad37cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.435008 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1ac6f-b699-4ba3-8b0b-f115dad37cad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.435741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1ac6f-b699-4ba3-8b0b-f115dad37cad admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.437960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1ac6f-b699-4ba3-8b0b-f115dad37cad admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:21.454888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-e5db6ff7-84c5-4373-ad10-a8c102ac3408 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:21.456391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e5db6ff7-84c5-4373-ad10-a8c102ac3408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:21.464177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 477/937] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Feb 16 09:15:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:15:21.475459 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 461/938] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:21 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:21.502699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1ac6f-b699-4ba3-8b0b-f115dad37cad admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.514085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1ac6f-b699-4ba3-8b0b-f115dad37cad admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.519528 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe68c0-69ae-4bf8-bcae-7254afbcd971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.520680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe68c0-69ae-4bf8-bcae-7254afbcd971 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.521107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe68c0-69ae-4bf8-bcae-7254afbcd971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.521544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe68c0-69ae-4bf8-bcae-7254afbcd971 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.536328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe68c0-69ae-4bf8-bcae-7254afbcd971 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:21.542335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-22fe68c0-69ae-4bf8-bcae-7254afbcd971 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 09:15:21.544222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 478/939] 10.222.0.90 () {56 vars in 1141 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:21.552920 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6ff7-84c5-4373-ad10-a8c102ac3408 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.568018 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db6ff7-84c5-4373-ad10-a8c102ac3408 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.575327 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27457c5b-204c-4c7e-b1d5-d489428848fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.576802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27457c5b-204c-4c7e-b1d5-d489428848fd admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.577481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27457c5b-204c-4c7e-b1d5-d489428848fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.578140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27457c5b-204c-4c7e-b1d5-d489428848fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.579709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27457c5b-204c-4c7e-b1d5-d489428848fd admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:21.580508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27457c5b-204c-4c7e-b1d5-d489428848fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.583347 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27457c5b-204c-4c7e-b1d5-d489428848fd admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:21.594836 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 462/940] 10.222.0.90 () {56 vars in 1136 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:21.601510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe68c0-69ae-4bf8-bcae-7254afbcd971 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.614537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe68c0-69ae-4bf8-bcae-7254afbcd971 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.620574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8328a-cd7c-4146-96e2-1facd782b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.621615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8328a-cd7c-4146-96e2-1facd782b7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.622044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8328a-cd7c-4146-96e2-1facd782b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.622460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8328a-cd7c-4146-96e2-1facd782b7f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.634704 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8328a-cd7c-4146-96e2-1facd782b7f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.636847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8328a-cd7c-4146-96e2-1facd782b7f3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:21.656054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-a1f8328a-cd7c-4146-96e2-1facd782b7f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:21.657913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 479/941] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:21.663743 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27457c5b-204c-4c7e-b1d5-d489428848fd admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.675352 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27457c5b-204c-4c7e-b1d5-d489428848fd admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.680914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7214ea2-fb60-4f93-9502-4370d98082f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.681663 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7214ea2-fb60-4f93-9502-4370d98082f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.682020 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7214ea2-fb60-4f93-9502-4370d98082f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.682366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7214ea2-fb60-4f93-9502-4370d98082f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.683159 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7214ea2-fb60-4f93-9502-4370d98082f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:21.683535 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7214ea2-fb60-4f93-9502-4370d98082f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.685241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7214ea2-fb60-4f93-9502-4370d98082f1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:21.698958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 463/942] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:21.705432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8328a-cd7c-4146-96e2-1facd782b7f3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.716038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8328a-cd7c-4146-96e2-1facd782b7f3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.722872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419644f2-6e80-4b2f-9ebb-f0351cf7fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.723675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419644f2-6e80-4b2f-9ebb-f0351cf7fd9a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.723953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419644f2-6e80-4b2f-9ebb-f0351cf7fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.724248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419644f2-6e80-4b2f-9ebb-f0351cf7fd9a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.731928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419644f2-6e80-4b2f-9ebb-f0351cf7fd9a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.734910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419644f2-6e80-4b2f-9ebb-f0351cf7fd9a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:21.751992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-419644f2-6e80-4b2f-9ebb-f0351cf7fd9a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 09:15:21.753883 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 480/943] 10.222.0.90 () {56 vars in 1138 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:21.759180 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7214ea2-fb60-4f93-9502-4370d98082f1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.769673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7214ea2-fb60-4f93-9502-4370d98082f1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.774653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60baaf6-0c9a-47e3-87f0-33b2164dc4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.775544 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60baaf6-0c9a-47e3-87f0-33b2164dc4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.775970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60baaf6-0c9a-47e3-87f0-33b2164dc4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.776463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60baaf6-0c9a-47e3-87f0-33b2164dc4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.777502 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60baaf6-0c9a-47e3-87f0-33b2164dc4e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:21.777958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60baaf6-0c9a-47e3-87f0-33b2164dc4e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.780778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60baaf6-0c9a-47e3-87f0-33b2164dc4e7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:21.800351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 464/944] 10.222.0.90 () {56 vars in 1170 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:21.808567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419644f2-6e80-4b2f-9ebb-f0351cf7fd9a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.818871 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419644f2-6e80-4b2f-9ebb-f0351cf7fd9a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.823848 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9bd28-e3e8-41f1-a0cb-b0fade0dcd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.824707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9bd28-e3e8-41f1-a0cb-b0fade0dcd74 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.825211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9bd28-e3e8-41f1-a0cb-b0fade0dcd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.825660 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9bd28-e3e8-41f1-a0cb-b0fade0dcd74 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.834406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9bd28-e3e8-41f1-a0cb-b0fade0dcd74 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.836473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9bd28-e3e8-41f1-a0cb-b0fade0dcd74 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:21.847215 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 481/945] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/auth/tokens => generated 2138 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:15:21.853229 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60baaf6-0c9a-47e3-87f0-33b2164dc4e7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.864383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60baaf6-0c9a-47e3-87f0-33b2164dc4e7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.869458 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c346f-3940-40eb-b6d9-8d1d601945ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.870438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c346f-3940-40eb-b6d9-8d1d601945ca admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.870928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c346f-3940-40eb-b6d9-8d1d601945ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.871375 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c346f-3940-40eb-b6d9-8d1d601945ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.882587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c346f-3940-40eb-b6d9-8d1d601945ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.884758 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c346f-3940-40eb-b6d9-8d1d601945ca admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:21.902783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-010c346f-3940-40eb-b6d9-8d1d601945ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:21.904352 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 465/946] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:21.910765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9bd28-e3e8-41f1-a0cb-b0fade0dcd74 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.920372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9bd28-e3e8-41f1-a0cb-b0fade0dcd74 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.929227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0bd74-1865-4fcc-bbf5-0cf3ab81f2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.929960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0bd74-1865-4fcc-bbf5-0cf3ab81f2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.930302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0bd74-1865-4fcc-bbf5-0cf3ab81f2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.930584 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0bd74-1865-4fcc-bbf5-0cf3ab81f2ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.931326 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0bd74-1865-4fcc-bbf5-0cf3ab81f2ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:21.931635 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0bd74-1865-4fcc-bbf5-0cf3ab81f2ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.933403 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0bd74-1865-4fcc-bbf5-0cf3ab81f2ab admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:21.946619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 482/947] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:21.952796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c346f-3940-40eb-b6d9-8d1d601945ca admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:21.970552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c346f-3940-40eb-b6d9-8d1d601945ca admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:21.975268 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce718c-6f8a-494f-8791-069598271b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:21.976155 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce718c-6f8a-494f-8791-069598271b10 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:21.976440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce718c-6f8a-494f-8791-069598271b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:21.976712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce718c-6f8a-494f-8791-069598271b10 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:21.984786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce718c-6f8a-494f-8791-069598271b10 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:21.986831 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce718c-6f8a-494f-8791-069598271b10 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:22.000604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-d6ce718c-6f8a-494f-8791-069598271b10 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:22.002089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 466/948] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:22.007756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0bd74-1865-4fcc-bbf5-0cf3ab81f2ab admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:22.020567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0bd74-1865-4fcc-bbf5-0cf3ab81f2ab admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:22.025289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b45724-bd6d-4577-be28-99b8fb8a80eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:22.025936 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b45724-bd6d-4577-be28-99b8fb8a80eb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.026221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b45724-bd6d-4577-be28-99b8fb8a80eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.026538 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b45724-bd6d-4577-be28-99b8fb8a80eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.027318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b45724-bd6d-4577-be28-99b8fb8a80eb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:22.027676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b45724-bd6d-4577-be28-99b8fb8a80eb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:22.029606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b45724-bd6d-4577-be28-99b8fb8a80eb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:22.043111 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 483/949] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:22.049207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce718c-6f8a-494f-8791-069598271b10 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:22.060570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce718c-6f8a-494f-8791-069598271b10 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:22.065649 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169ad67-b0c8-41e4-b28e-9334855c4f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:22.066377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169ad67-b0c8-41e4-b28e-9334855c4f56 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.066658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169ad67-b0c8-41e4-b28e-9334855c4f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.066974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169ad67-b0c8-41e4-b28e-9334855c4f56 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.067814 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169ad67-b0c8-41e4-b28e-9334855c4f56 admin admin] RBAC: Adding query filter params (role.id=6b4e412de235405e8eff8775eca34b6b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=ffcd409f87f84fe3bf25715e84c41af6) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:22.068222 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169ad67-b0c8-41e4-b28e-9334855c4f56 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:22.070230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169ad67-b0c8-41e4-b28e-9334855c4f56 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:22.077935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 467/950] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:22 2022] GET /identity/v3/role_assignments?user.id=ffcd409f87f84fe3bf25715e84c41af6&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=6b4e412de235405e8eff8775eca34b6b => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:22.309041 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddc2e2-1cbf-4fbd-ab24-9e0be262cc34 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.309573 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddc2e2-1cbf-4fbd-ab24-9e0be262cc34 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.309573 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddc2e2-1cbf-4fbd-ab24-9e0be262cc34 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.312118 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 484/951] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:22.317747 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1125bc-1b25-40f2-b349-dd45760448b6 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.318582 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1125bc-1b25-40f2-b349-dd45760448b6 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.319064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1125bc-1b25-40f2-b349-dd45760448b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.337784 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-9a1125bc-1b25-40f2-b349-dd45760448b6 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:22.339279 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9a1125bc-1b25-40f2-b349-dd45760448b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:22.348677 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 468/952] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:22 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:22.372270 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddc2e2-1cbf-4fbd-ab24-9e0be262cc34 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:22.386087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddc2e2-1cbf-4fbd-ab24-9e0be262cc34 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:22.391901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5b9d8-87c7-40ad-9fc6-b4cc41b4cf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:22.392896 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b9d8-87c7-40ad-9fc6-b4cc41b4cf40 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.393320 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b9d8-87c7-40ad-9fc6-b4cc41b4cf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.393731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5b9d8-87c7-40ad-9fc6-b4cc41b4cf40 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.394643 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5b9d8-87c7-40ad-9fc6-b4cc41b4cf40 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:22.396405 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5b9d8-87c7-40ad-9fc6-b4cc41b4cf40 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:22.408046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-06b5b9d8-87c7-40ad-9fc6-b4cc41b4cf40 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 09:15:22.409709 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 485/953] 10.222.0.90 () {56 vars in 1147 bytes} [Wed Feb 16 09:15:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:22.415725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1125bc-1b25-40f2-b349-dd45760448b6 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:22.425427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1125bc-1b25-40f2-b349-dd45760448b6 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:22.440202 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bb16e-ef4e-4185-bea7-6592bf37161a None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.440485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bb16e-ef4e-4185-bea7-6592bf37161a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.440776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bb16e-ef4e-4185-bea7-6592bf37161a None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.446596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 486/954] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:22.449402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a59fe-fa16-437d-9040-e66af0b086c0 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.449515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf1067-dea0-4a77-88cf-591c025264a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:22.449676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a59fe-fa16-437d-9040-e66af0b086c0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.449943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a59fe-fa16-437d-9040-e66af0b086c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.450102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf1067-dea0-4a77-88cf-591c025264a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.450739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf1067-dea0-4a77-88cf-591c025264a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.450739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf1067-dea0-4a77-88cf-591c025264a5 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.451439 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf1067-dea0-4a77-88cf-591c025264a5 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:22.451786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf1067-dea0-4a77-88cf-591c025264a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:22.454107 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf1067-dea0-4a77-88cf-591c025264a5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:22.463790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 469/955] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Feb 16 09:15:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:22.468044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf1067-dea0-4a77-88cf-591c025264a5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:22.492051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf1067-dea0-4a77-88cf-591c025264a5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:22.508054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417ed07-333c-4404-a517-fea6ac829e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:22.508247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-663a59fe-fa16-437d-9040-e66af0b086c0 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:22.508357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417ed07-333c-4404-a517-fea6ac829e8e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.508357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417ed07-333c-4404-a517-fea6ac829e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.508357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417ed07-333c-4404-a517-fea6ac829e8e admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.508533 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-663a59fe-fa16-437d-9040-e66af0b086c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:22.512045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417ed07-333c-4404-a517-fea6ac829e8e admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:22.512045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417ed07-333c-4404-a517-fea6ac829e8e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:22.516053 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417ed07-333c-4404-a517-fea6ac829e8e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:22.527614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 470/956] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Feb 16 09:15:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:22.529009 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 487/957] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:22 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:22.541169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417ed07-333c-4404-a517-fea6ac829e8e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:22.553212 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417ed07-333c-4404-a517-fea6ac829e8e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:22.560062 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd4335-5b9c-4350-b724-b7fa5090a974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:22.560062 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd4335-5b9c-4350-b724-b7fa5090a974 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.560062 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd4335-5b9c-4350-b724-b7fa5090a974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.560062 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd4335-5b9c-4350-b724-b7fa5090a974 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.560385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd4335-5b9c-4350-b724-b7fa5090a974 admin admin] RBAC: Adding query filter params (interface=public, service_id=0bdbd42d63174eb49bfa3e0de4055ed1, region_id=RegionOne) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:22.560385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd4335-5b9c-4350-b724-b7fa5090a974 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:22.562605 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd4335-5b9c-4350-b724-b7fa5090a974 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:22.568044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a59fe-fa16-437d-9040-e66af0b086c0 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:22.578638 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 471/958] 10.222.0.90 () {56 vars in 1272 bytes} [Wed Feb 16 09:15:22 2022] GET /identity/v3/endpoints?service_id=0bdbd42d63174eb49bfa3e0de4055ed1&interface=public®ion_id=RegionOne => generated 194 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:22.584050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a59fe-fa16-437d-9040-e66af0b086c0 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:22.585368 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd4335-5b9c-4350-b724-b7fa5090a974 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:22.589133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc65b2-cd9e-4c54-8396-265c8fd231d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:22.590043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc65b2-cd9e-4c54-8396-265c8fd231d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.594119 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc65b2-cd9e-4c54-8396-265c8fd231d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.594119 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc65b2-cd9e-4c54-8396-265c8fd231d3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.596807 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc65b2-cd9e-4c54-8396-265c8fd231d3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:22.598435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc65b2-cd9e-4c54-8396-265c8fd231d3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:22.607947 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd4335-5b9c-4350-b724-b7fa5090a974 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:22.615723 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254cefe-580b-40df-9822-7b6adfb350f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:22.627709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254cefe-580b-40df-9822-7b6adfb350f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.627709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254cefe-580b-40df-9822-7b6adfb350f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.627709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254cefe-580b-40df-9822-7b6adfb350f3 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.628269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-f1dc65b2-cd9e-4c54-8396-265c8fd231d3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 16 09:15:22.632049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254cefe-580b-40df-9822-7b6adfb350f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:22.632049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254cefe-580b-40df-9822-7b6adfb350f3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:22.633822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 488/959] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:22.642876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc65b2-cd9e-4c54-8396-265c8fd231d3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:22.655648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 472/960] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Feb 16 09:15:22 2022] GET /identity/v3/services => generated 1497 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:15:22.664054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc65b2-cd9e-4c54-8396-265c8fd231d3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:22.668081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547e034-f936-4c25-90fa-d92a1ccee4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:22.668081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547e034-f936-4c25-90fa-d92a1ccee4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.668081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547e034-f936-4c25-90fa-d92a1ccee4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.668081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547e034-f936-4c25-90fa-d92a1ccee4c3 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.668911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547e034-f936-4c25-90fa-d92a1ccee4c3 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:22.668911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547e034-f936-4c25-90fa-d92a1ccee4c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:22.672051 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547e034-f936-4c25-90fa-d92a1ccee4c3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:22.680060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 489/961] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:22.683775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254cefe-580b-40df-9822-7b6adfb350f3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:22.702865 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254cefe-580b-40df-9822-7b6adfb350f3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:22.709459 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e779af-c9a9-4212-a14a-ffba2eaf645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:22.710132 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e779af-c9a9-4212-a14a-ffba2eaf645f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:22.710407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e779af-c9a9-4212-a14a-ffba2eaf645f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:22.710677 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e779af-c9a9-4212-a14a-ffba2eaf645f admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:22.711393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e779af-c9a9-4212-a14a-ffba2eaf645f admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:22.711692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e779af-c9a9-4212-a14a-ffba2eaf645f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:22.713695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e779af-c9a9-4212-a14a-ffba2eaf645f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:22.722901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 473/962] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:24.087128 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779568a-a7fd-456c-b567-13e7b1a25e27 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:24.087650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779568a-a7fd-456c-b567-13e7b1a25e27 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:24.087650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779568a-a7fd-456c-b567-13e7b1a25e27 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:24.089759 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 490/963] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:24.095284 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8fcc1-bcf3-4462-b9d8-b467d33ec55b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:24.095729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8fcc1-bcf3-4462-b9d8-b467d33ec55b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:24.095895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8fcc1-bcf3-4462-b9d8-b467d33ec55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:24.114275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-b4d8fcc1-bcf3-4462-b9d8-b467d33ec55b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:24.115471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-b4d8fcc1-bcf3-4462-b9d8-b467d33ec55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:24.128126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 474/964] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:24 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:24.149957 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779568a-a7fd-456c-b567-13e7b1a25e27 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:24.162571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779568a-a7fd-456c-b567-13e7b1a25e27 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:24.167053 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879c42c-56ca-47ff-a177-c56044e3d2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:24.167693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879c42c-56ca-47ff-a177-c56044e3d2eb admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:24.167973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879c42c-56ca-47ff-a177-c56044e3d2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:24.168277 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879c42c-56ca-47ff-a177-c56044e3d2eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:24.168989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879c42c-56ca-47ff-a177-c56044e3d2eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:24.170856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879c42c-56ca-47ff-a177-c56044e3d2eb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:24.172229 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.common [None req-0879c42c-56ca-47ff-a177-c56044e3d2eb admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 16 09:15:24.193186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.sql.core [None req-0879c42c-56ca-47ff-a177-c56044e3d2eb admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 16 09:15:24.193186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 16 09:15:24.193186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [parameters: {'id': 'a9aea084f67b475281e9f618344dd234', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 16 09:15:24.193186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79276) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 16 09:15:24.209211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-0879c42c-56ca-47ff-a177-c56044e3d2eb admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9aea084f67b475281e9f618344dd234.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9aea084f67b475281e9f618344dd234. Feb 16 09:15:24.215507 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 491/965] 10.222.0.90 () {60 vars in 1161 bytes} [Wed Feb 16 09:15:24 2022] POST /identity/v3/projects => generated 262 bytes in 61 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:24.216923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8fcc1-bcf3-4462-b9d8-b467d33ec55b None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:24.226437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8fcc1-bcf3-4462-b9d8-b467d33ec55b None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:24.231181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed074f82-dd40-4c82-8d31-c3ef4743c3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:24.232011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed074f82-dd40-4c82-8d31-c3ef4743c3fb admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:24.232364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed074f82-dd40-4c82-8d31-c3ef4743c3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:24.232638 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed074f82-dd40-4c82-8d31-c3ef4743c3fb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:24.240950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed074f82-dd40-4c82-8d31-c3ef4743c3fb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:24.242962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed074f82-dd40-4c82-8d31-c3ef4743c3fb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:24.257370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-ed074f82-dd40-4c82-8d31-c3ef4743c3fb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:24.263959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 475/966] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:24.266438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879c42c-56ca-47ff-a177-c56044e3d2eb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:24.277589 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879c42c-56ca-47ff-a177-c56044e3d2eb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:24.283232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb9d80-df1d-49de-803e-0a4c74288e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:24.284063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb9d80-df1d-49de-803e-0a4c74288e50 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:24.284352 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb9d80-df1d-49de-803e-0a4c74288e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:24.284674 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb9d80-df1d-49de-803e-0a4c74288e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:24.285457 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb9d80-df1d-49de-803e-0a4c74288e50 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:24.285830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb9d80-df1d-49de-803e-0a4c74288e50 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:24.288193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb9d80-df1d-49de-803e-0a4c74288e50 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:24.311693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 492/967] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:24.634114 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4169d-f610-43db-860b-856c3cbdc878 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:24.634494 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4169d-f610-43db-860b-856c3cbdc878 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:24.634691 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4169d-f610-43db-860b-856c3cbdc878 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:24.636759 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 476/968] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:24.642945 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4071e6-7513-4968-aee4-72fa627729f6 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:24.643230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4071e6-7513-4968-aee4-72fa627729f6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:24.643505 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4071e6-7513-4968-aee4-72fa627729f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:24.662552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-bc4071e6-7513-4968-aee4-72fa627729f6 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:24.664060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bc4071e6-7513-4968-aee4-72fa627729f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:24.672910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 493/969] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:24 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:24.695622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4169d-f610-43db-860b-856c3cbdc878 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:24.709592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4169d-f610-43db-860b-856c3cbdc878 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:24.714211 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a0a50-4589-4050-bb00-d25554ba4dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:24.714980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a0a50-4589-4050-bb00-d25554ba4dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:24.715255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a0a50-4589-4050-bb00-d25554ba4dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:24.715576 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a0a50-4589-4050-bb00-d25554ba4dbe admin admin] PATH_INFO: `/v3/services/image` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:24.716250 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a0a50-4589-4050-bb00-d25554ba4dbe admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:24.718461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a0a50-4589-4050-bb00-d25554ba4dbe admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:24.729837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-8c2a0a50-4589-4050-bb00-d25554ba4dbe admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 16 09:15:24.731361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 477/970] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Feb 16 09:15:24 2022] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:24.737786 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4071e6-7513-4968-aee4-72fa627729f6 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:24.746902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4071e6-7513-4968-aee4-72fa627729f6 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:24.751570 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03395de9-3531-4092-a7e9-5499cedc81fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:24.752310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03395de9-3531-4092-a7e9-5499cedc81fc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:24.752587 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03395de9-3531-4092-a7e9-5499cedc81fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:24.752857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03395de9-3531-4092-a7e9-5499cedc81fc admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:24.753556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03395de9-3531-4092-a7e9-5499cedc81fc admin admin] RBAC: Adding query filter params (name=image) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:24.753857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03395de9-3531-4092-a7e9-5499cedc81fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:24.755451 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03395de9-3531-4092-a7e9-5499cedc81fc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:24.760960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 494/971] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:24.767010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a0a50-4589-4050-bb00-d25554ba4dbe admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:24.776879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a0a50-4589-4050-bb00-d25554ba4dbe admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:24.782334 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e4f2e-2e57-42a1-9f10-8b5b695648b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:24.783035 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e4f2e-2e57-42a1-9f10-8b5b695648b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:24.783314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e4f2e-2e57-42a1-9f10-8b5b695648b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:24.783586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e4f2e-2e57-42a1-9f10-8b5b695648b4 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:24.784346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e4f2e-2e57-42a1-9f10-8b5b695648b4 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:24.784645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e4f2e-2e57-42a1-9f10-8b5b695648b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:24.786269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e4f2e-2e57-42a1-9f10-8b5b695648b4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:24.791488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 478/972] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:25.273121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ca263-a7ad-43e4-9ca9-37a7cf2714a2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:25.273121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ca263-a7ad-43e4-9ca9-37a7cf2714a2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:25.273121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ca263-a7ad-43e4-9ca9-37a7cf2714a2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:25.273121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 495/973] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:25.284349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319abb4-e6f6-4eee-8977-821aa887d15f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:25.284349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319abb4-e6f6-4eee-8977-821aa887d15f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:25.284349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319abb4-e6f6-4eee-8977-821aa887d15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:25.299809 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-5319abb4-e6f6-4eee-8977-821aa887d15f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:25.301288 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-5319abb4-e6f6-4eee-8977-821aa887d15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:25.303977 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c61a84-1379-4009-9090-7f60d989a1a0 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:25.304534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c61a84-1379-4009-9090-7f60d989a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:25.305026 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c61a84-1379-4009-9090-7f60d989a1a0 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:25.307202 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 496/974] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:15:25.309803 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 479/975] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:25 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:25.313117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd61ba-e38c-4606-b3b4-5aa20b6391c5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:25.313611 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd61ba-e38c-4606-b3b4-5aa20b6391c5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:25.314096 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd61ba-e38c-4606-b3b4-5aa20b6391c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:25.332434 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-dbdd61ba-e38c-4606-b3b4-5aa20b6391c5 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:25.334129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-dbdd61ba-e38c-4606-b3b4-5aa20b6391c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:25.334903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319abb4-e6f6-4eee-8977-821aa887d15f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:25.342796 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 497/976] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:25 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:25.348044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319abb4-e6f6-4eee-8977-821aa887d15f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:25.349912 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767325d-a8f4-419b-96fa-d066f2b8be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:25.350770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767325d-a8f4-419b-96fa-d066f2b8be58 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:25.351119 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767325d-a8f4-419b-96fa-d066f2b8be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:25.351483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767325d-a8f4-419b-96fa-d066f2b8be58 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:25.352231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767325d-a8f4-419b-96fa-d066f2b8be58 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:25.353877 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767325d-a8f4-419b-96fa-d066f2b8be58 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:25.365334 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-3767325d-a8f4-419b-96fa-d066f2b8be58 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 09:15:25.366988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 480/977] 10.222.0.90 () {56 vars in 1147 bytes} [Wed Feb 16 09:15:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:25.367731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd61ba-e38c-4606-b3b4-5aa20b6391c5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:25.372701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767325d-a8f4-419b-96fa-d066f2b8be58 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:25.378218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd61ba-e38c-4606-b3b4-5aa20b6391c5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:25.383031 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440db3-ca6e-4e20-9789-54ce3547778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:25.383597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767325d-a8f4-419b-96fa-d066f2b8be58 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:25.384230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440db3-ca6e-4e20-9789-54ce3547778f admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:25.384711 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440db3-ca6e-4e20-9789-54ce3547778f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:25.385191 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440db3-ca6e-4e20-9789-54ce3547778f admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:25.386097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a440db3-ca6e-4e20-9789-54ce3547778f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:25.387900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a440db3-ca6e-4e20-9789-54ce3547778f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:25.388247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632367-8735-4bad-804a-ebaed10ea0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:25.388969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632367-8735-4bad-804a-ebaed10ea0fe admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:25.389817 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632367-8735-4bad-804a-ebaed10ea0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:25.390130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4632367-8735-4bad-804a-ebaed10ea0fe admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:25.391086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4632367-8735-4bad-804a-ebaed10ea0fe admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:25.391388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4632367-8735-4bad-804a-ebaed10ea0fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:25.392979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4632367-8735-4bad-804a-ebaed10ea0fe admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:25.400079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 481/978] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Feb 16 09:15:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:25.406659 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632367-8735-4bad-804a-ebaed10ea0fe admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:25.411616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 498/979] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:15:25 2022] POST /identity/v3/services => generated 242 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:15:25.422402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4632367-8735-4bad-804a-ebaed10ea0fe admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:25.439970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89bf1e-0eda-42c3-a757-08268c2b147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:25.441071 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89bf1e-0eda-42c3-a757-08268c2b147a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:25.441523 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89bf1e-0eda-42c3-a757-08268c2b147a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:25.441942 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89bf1e-0eda-42c3-a757-08268c2b147a admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:25.442903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89bf1e-0eda-42c3-a757-08268c2b147a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:25.443567 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89bf1e-0eda-42c3-a757-08268c2b147a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:25.445593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89bf1e-0eda-42c3-a757-08268c2b147a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:25.453279 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 482/980] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Feb 16 09:15:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:25.461469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440db3-ca6e-4e20-9789-54ce3547778f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:25.473496 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440db3-ca6e-4e20-9789-54ce3547778f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:25.478713 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c2280-87ab-4310-a4b6-ae6a1b6c328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:25.479574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c2280-87ab-4310-a4b6-ae6a1b6c328e admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:25.479970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c2280-87ab-4310-a4b6-ae6a1b6c328e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:25.480476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c2280-87ab-4310-a4b6-ae6a1b6c328e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:25.481381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c2280-87ab-4310-a4b6-ae6a1b6c328e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:25.483875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c2280-87ab-4310-a4b6-ae6a1b6c328e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:25.508773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 499/981] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Feb 16 09:15:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:15:26.719154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477cd80-54d4-4599-8cc5-4c23d8dbe6ba None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:26.719700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477cd80-54d4-4599-8cc5-4c23d8dbe6ba None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:26.720047 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477cd80-54d4-4599-8cc5-4c23d8dbe6ba None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:26.721908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 483/982] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:26.727462 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4c823-da40-474e-8057-14154bfe9b57 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:26.728106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4c823-da40-474e-8057-14154bfe9b57 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:26.728106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4c823-da40-474e-8057-14154bfe9b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:26.746239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5de4c823-da40-474e-8057-14154bfe9b57 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:26.747415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5de4c823-da40-474e-8057-14154bfe9b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:26.765283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 500/983] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:26 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:26.790806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477cd80-54d4-4599-8cc5-4c23d8dbe6ba None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:26.803176 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477cd80-54d4-4599-8cc5-4c23d8dbe6ba None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:26.807558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c8695-fcae-4708-8154-e24b8d254c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:26.808249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c8695-fcae-4708-8154-e24b8d254c2f admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:26.808528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c8695-fcae-4708-8154-e24b8d254c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:26.808798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c8695-fcae-4708-8154-e24b8d254c2f admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:26.809489 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c8695-fcae-4708-8154-e24b8d254c2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:26.811938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c8695-fcae-4708-8154-e24b8d254c2f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:26.813241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.common [None req-6c7c8695-fcae-4708-8154-e24b8d254c2f admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 16 09:15:26.828495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.sql.core [None req-6c7c8695-fcae-4708-8154-e24b8d254c2f admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 16 09:15:26.828495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 16 09:15:26.828495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [parameters: {'user_id': '8f5156051c494828984bd7f70bb064c8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 16 09:15:26.828495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79275) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 16 09:15:26.834469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-6c7c8695-fcae-4708-8154-e24b8d254c2f admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 16 09:15:26.836162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 484/984] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:15:26 2022] POST /identity/v3/users => generated 160 bytes in 46 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:26.842240 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4c823-da40-474e-8057-14154bfe9b57 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:26.851668 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4c823-da40-474e-8057-14154bfe9b57 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:26.856580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8c9b0-ad8f-4bde-b6df-d95fa349bd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:26.857473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8c9b0-ad8f-4bde-b6df-d95fa349bd2f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:26.857846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8c9b0-ad8f-4bde-b6df-d95fa349bd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:26.858332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8c9b0-ad8f-4bde-b6df-d95fa349bd2f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:26.866254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8c9b0-ad8f-4bde-b6df-d95fa349bd2f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:26.868394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8c9b0-ad8f-4bde-b6df-d95fa349bd2f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:26.886016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-88d8c9b0-ad8f-4bde-b6df-d95fa349bd2f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 09:15:26.887776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 501/985] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:15:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:26.895089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c8695-fcae-4708-8154-e24b8d254c2f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:26.907785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c8695-fcae-4708-8154-e24b8d254c2f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:26.912856 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01a7a2-11ee-4ba6-b3da-a466fd2b8c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:26.913766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01a7a2-11ee-4ba6-b3da-a466fd2b8c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:26.914251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01a7a2-11ee-4ba6-b3da-a466fd2b8c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:26.914731 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01a7a2-11ee-4ba6-b3da-a466fd2b8c97 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:26.915712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01a7a2-11ee-4ba6-b3da-a466fd2b8c97 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:26.916247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01a7a2-11ee-4ba6-b3da-a466fd2b8c97 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:26.918622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01a7a2-11ee-4ba6-b3da-a466fd2b8c97 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:26.958453 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 485/986] 10.222.0.90 () {56 vars in 1122 bytes} [Wed Feb 16 09:15:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:27.270057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e8b9d-92a1-44bb-a407-7f55edbc792b None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:27.270405 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e8b9d-92a1-44bb-a407-7f55edbc792b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:27.270509 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e8b9d-92a1-44bb-a407-7f55edbc792b None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:27.272366 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 502/987] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:27.277711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b98737-c587-4c3d-8dd2-9f35eafd63ac None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:27.278120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b98737-c587-4c3d-8dd2-9f35eafd63ac None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:27.278406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b98737-c587-4c3d-8dd2-9f35eafd63ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:27.297557 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-c7b98737-c587-4c3d-8dd2-9f35eafd63ac None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:27.299087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c7b98737-c587-4c3d-8dd2-9f35eafd63ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:27.306881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 486/988] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:27 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:27.330596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e8b9d-92a1-44bb-a407-7f55edbc792b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:27.343753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e8b9d-92a1-44bb-a407-7f55edbc792b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:27.349378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628bfed-1d95-466e-839c-699adfcbf4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:27.350486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628bfed-1d95-466e-839c-699adfcbf4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:27.350976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628bfed-1d95-466e-839c-699adfcbf4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:27.351355 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628bfed-1d95-466e-839c-699adfcbf4b4 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:27.352197 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628bfed-1d95-466e-839c-699adfcbf4b4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:27.354282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628bfed-1d95-466e-839c-699adfcbf4b4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:27.368586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 503/989] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:15:27 2022] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:15:27.859110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1d7d2-31e3-4af2-9407-d423ba9f0f2e None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:27.859727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1d7d2-31e3-4af2-9407-d423ba9f0f2e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:27.859727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1d7d2-31e3-4af2-9407-d423ba9f0f2e None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:27.861566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 487/990] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:27.867030 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c2c2-5294-4fba-a634-40cdb2cee382 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:27.867456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c2c2-5294-4fba-a634-40cdb2cee382 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:27.867623 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c2c2-5294-4fba-a634-40cdb2cee382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:27.885144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a3a1c2c2-5294-4fba-a634-40cdb2cee382 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:27.886326 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a3a1c2c2-5294-4fba-a634-40cdb2cee382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:27.895263 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7a0be-4a01-4ca1-b59a-af3c4724a509 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:27.895547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7a0be-4a01-4ca1-b59a-af3c4724a509 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:27.895823 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7a0be-4a01-4ca1-b59a-af3c4724a509 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:27.897597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 488/991] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:27.902837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed3323-f25c-4cf9-9db4-a6eb00ec0cfa None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:27.903220 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed3323-f25c-4cf9-9db4-a6eb00ec0cfa None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:27.903496 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ed3323-f25c-4cf9-9db4-a6eb00ec0cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:27.904375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 504/992] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:27 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:27.921768 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a3ed3323-f25c-4cf9-9db4-a6eb00ec0cfa None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:27.922930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a3ed3323-f25c-4cf9-9db4-a6eb00ec0cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:27.928646 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1c2c2-5294-4fba-a634-40cdb2cee382 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:27.930924 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 489/993] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:27 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:27.937713 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1c2c2-5294-4fba-a634-40cdb2cee382 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:27.942154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afc6cd-3f14-4ad1-9b98-981ced77ee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:27.942927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afc6cd-3f14-4ad1-9b98-981ced77ee29 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:27.943210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afc6cd-3f14-4ad1-9b98-981ced77ee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:27.943488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afc6cd-3f14-4ad1-9b98-981ced77ee29 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:27.944216 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afc6cd-3f14-4ad1-9b98-981ced77ee29 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:27.945812 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1afc6cd-3f14-4ad1-9b98-981ced77ee29 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:27.954479 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed3323-f25c-4cf9-9db4-a6eb00ec0cfa None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:27.957460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e1afc6cd-3f14-4ad1-9b98-981ced77ee29 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 16 09:15:27.958628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 505/994] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:27.963710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ed3323-f25c-4cf9-9db4-a6eb00ec0cfa None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:27.964330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afc6cd-3f14-4ad1-9b98-981ced77ee29 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:27.968988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4536fc-11df-468e-bc2e-85935d1a5f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:27.969782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4536fc-11df-468e-bc2e-85935d1a5f60 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:27.970059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4536fc-11df-468e-bc2e-85935d1a5f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:27.970334 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4536fc-11df-468e-bc2e-85935d1a5f60 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:27.970983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4536fc-11df-468e-bc2e-85935d1a5f60 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:27.972626 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4536fc-11df-468e-bc2e-85935d1a5f60 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:27.974361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afc6cd-3f14-4ad1-9b98-981ced77ee29 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:27.978838 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f373bf-2ac3-464b-bf1b-5d210cbbc264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:27.979460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f373bf-2ac3-464b-bf1b-5d210cbbc264 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:27.979736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f373bf-2ac3-464b-bf1b-5d210cbbc264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:27.980007 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f373bf-2ac3-464b-bf1b-5d210cbbc264 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:27.980725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f373bf-2ac3-464b-bf1b-5d210cbbc264 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:27.981025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f373bf-2ac3-464b-bf1b-5d210cbbc264 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:27.982562 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f373bf-2ac3-464b-bf1b-5d210cbbc264 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:27.983750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-0f4536fc-11df-468e-bc2e-85935d1a5f60 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 09:15:27.988177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 490/995] 10.222.0.90 () {56 vars in 1147 bytes} [Wed Feb 16 09:15:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:27.990315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 506/996] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:27.990937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4536fc-11df-468e-bc2e-85935d1a5f60 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:27.996728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f373bf-2ac3-464b-bf1b-5d210cbbc264 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:28.000385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4536fc-11df-468e-bc2e-85935d1a5f60 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:28.004944 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0d385-cbf1-4565-9707-d5aeb3d82427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:28.005568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0d385-cbf1-4565-9707-d5aeb3d82427 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:28.005824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f373bf-2ac3-464b-bf1b-5d210cbbc264 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:28.005927 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0d385-cbf1-4565-9707-d5aeb3d82427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:28.006100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0d385-cbf1-4565-9707-d5aeb3d82427 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:28.006780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0d385-cbf1-4565-9707-d5aeb3d82427 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:28.007082 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0d385-cbf1-4565-9707-d5aeb3d82427 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:28.011072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0d385-cbf1-4565-9707-d5aeb3d82427 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:28.014646 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 491/997] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Feb 16 09:15:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:28.016589 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e5631-f83c-4852-8b9a-16eeda43e5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:28.017234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e5631-f83c-4852-8b9a-16eeda43e5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:28.017512 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e5631-f83c-4852-8b9a-16eeda43e5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:28.017782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e5631-f83c-4852-8b9a-16eeda43e5f2 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:28.018485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e5631-f83c-4852-8b9a-16eeda43e5f2 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:28.018787 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e5631-f83c-4852-8b9a-16eeda43e5f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:28.020381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e5631-f83c-4852-8b9a-16eeda43e5f2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:28.021096 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0d385-cbf1-4565-9707-d5aeb3d82427 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:28.030596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 507/998] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:28.031864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e5631-f83c-4852-8b9a-16eeda43e5f2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:28.034292 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0d385-cbf1-4565-9707-d5aeb3d82427 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:28.039037 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6068bbe-713e-4c80-a84d-d1cd35f71717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:28.039689 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6068bbe-713e-4c80-a84d-d1cd35f71717 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:28.039972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6068bbe-713e-4c80-a84d-d1cd35f71717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:28.040280 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6068bbe-713e-4c80-a84d-d1cd35f71717 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:28.040975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6068bbe-713e-4c80-a84d-d1cd35f71717 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:28.041282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6068bbe-713e-4c80-a84d-d1cd35f71717 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:28.041392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e5631-f83c-4852-8b9a-16eeda43e5f2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:28.042857 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6068bbe-713e-4c80-a84d-d1cd35f71717 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:28.046619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018987b-e071-429e-8b25-4df426f71627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:28.047109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018987b-e071-429e-8b25-4df426f71627 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:28.047449 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018987b-e071-429e-8b25-4df426f71627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:28.047771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018987b-e071-429e-8b25-4df426f71627 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:28.048588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018987b-e071-429e-8b25-4df426f71627 admin admin] RBAC: Adding query filter params (interface=public, service_id=8c47929ba8bd4b3f87890a4243126a10, region_id=RegionOne) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:28.053467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018987b-e071-429e-8b25-4df426f71627 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:28.053589 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 492/999] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Feb 16 09:15:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:28.053676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018987b-e071-429e-8b25-4df426f71627 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:28.054424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6068bbe-713e-4c80-a84d-d1cd35f71717 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:28.060073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 508/1000] 10.222.0.90 () {56 vars in 1272 bytes} [Wed Feb 16 09:15:28 2022] GET /identity/v3/endpoints?service_id=8c47929ba8bd4b3f87890a4243126a10&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:28.062095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018987b-e071-429e-8b25-4df426f71627 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:28.064764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6068bbe-713e-4c80-a84d-d1cd35f71717 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:28.069434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a6e7e-d605-4d59-a61e-2a50b5379a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:28.069969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a6e7e-d605-4d59-a61e-2a50b5379a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:28.070254 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a6e7e-d605-4d59-a61e-2a50b5379a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:28.070532 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a6e7e-d605-4d59-a61e-2a50b5379a47 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:28.071301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a6e7e-d605-4d59-a61e-2a50b5379a47 admin admin] RBAC: Adding query filter params (interface=admin, service_id=0bdbd42d63174eb49bfa3e0de4055ed1, region_id=RegionOne) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:28.071614 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018987b-e071-429e-8b25-4df426f71627 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:28.071722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a6e7e-d605-4d59-a61e-2a50b5379a47 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:28.073225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a6e7e-d605-4d59-a61e-2a50b5379a47 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:28.076185 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3668971-b2c2-4bb4-8081-42636ccab737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:28.076900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3668971-b2c2-4bb4-8081-42636ccab737 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:28.077179 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3668971-b2c2-4bb4-8081-42636ccab737 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:28.077466 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3668971-b2c2-4bb4-8081-42636ccab737 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:28.078121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3668971-b2c2-4bb4-8081-42636ccab737 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:28.078714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 493/1001] 10.222.0.90 () {56 vars in 1270 bytes} [Wed Feb 16 09:15:28 2022] GET /identity/v3/endpoints?service_id=0bdbd42d63174eb49bfa3e0de4055ed1&interface=admin®ion_id=RegionOne => generated 193 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:28.079686 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3668971-b2c2-4bb4-8081-42636ccab737 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:28.084236 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a6e7e-d605-4d59-a61e-2a50b5379a47 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:28.087436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 509/1002] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Feb 16 09:15:28 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:15:28.094048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a6e7e-d605-4d59-a61e-2a50b5379a47 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:28.098809 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d0e77-0a27-4c35-88fe-09bc05d68aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:28.099492 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d0e77-0a27-4c35-88fe-09bc05d68aae admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:28.099778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d0e77-0a27-4c35-88fe-09bc05d68aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:28.100099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d0e77-0a27-4c35-88fe-09bc05d68aae admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:28.100790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d0e77-0a27-4c35-88fe-09bc05d68aae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:28.102432 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d0e77-0a27-4c35-88fe-09bc05d68aae admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:28.112146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 494/1003] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Feb 16 09:15:28 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:15:29.741875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ee24-f457-44b6-8e1f-ae4f1899a5ba None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:29.742408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ee24-f457-44b6-8e1f-ae4f1899a5ba None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:29.742408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71ee24-f457-44b6-8e1f-ae4f1899a5ba None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:29.744283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 510/1004] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:29.749995 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7129ef0-dfae-47de-8a10-8c0f2e3bda65 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:29.750882 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7129ef0-dfae-47de-8a10-8c0f2e3bda65 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:29.751364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7129ef0-dfae-47de-8a10-8c0f2e3bda65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:29.769773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a7129ef0-dfae-47de-8a10-8c0f2e3bda65 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:29.771284 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a7129ef0-dfae-47de-8a10-8c0f2e3bda65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:29.779442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 495/1005] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:29 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:29.802711 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ee24-f457-44b6-8e1f-ae4f1899a5ba None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:29.815371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71ee24-f457-44b6-8e1f-ae4f1899a5ba None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:29.819656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74605-6b33-4830-ae8a-c4482ae32238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:29.820488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74605-6b33-4830-ae8a-c4482ae32238 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:29.820766 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74605-6b33-4830-ae8a-c4482ae32238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:29.821033 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74605-6b33-4830-ae8a-c4482ae32238 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:29.821671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f74605-6b33-4830-ae8a-c4482ae32238 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:29.823236 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f74605-6b33-4830-ae8a-c4482ae32238 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:29.834375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-d3f74605-6b33-4830-ae8a-c4482ae32238 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 16 09:15:29.835820 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 511/1006] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Feb 16 09:15:29 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:29.841551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7129ef0-dfae-47de-8a10-8c0f2e3bda65 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:29.851764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7129ef0-dfae-47de-8a10-8c0f2e3bda65 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:29.856713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874fd19-9a7e-4582-bb0f-372d917c0bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:29.857591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874fd19-9a7e-4582-bb0f-372d917c0bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:29.858727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874fd19-9a7e-4582-bb0f-372d917c0bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:29.859337 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874fd19-9a7e-4582-bb0f-372d917c0bf0 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:29.860306 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874fd19-9a7e-4582-bb0f-372d917c0bf0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:29.860808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874fd19-9a7e-4582-bb0f-372d917c0bf0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:29.862595 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874fd19-9a7e-4582-bb0f-372d917c0bf0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:29.868303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 496/1007] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:29.873669 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74605-6b33-4830-ae8a-c4482ae32238 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:29.884057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74605-6b33-4830-ae8a-c4482ae32238 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:29.888733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0d5d7-ba31-45b1-bbf6-f4e9cc4649f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:29.889673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0d5d7-ba31-45b1-bbf6-f4e9cc4649f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:29.890152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0d5d7-ba31-45b1-bbf6-f4e9cc4649f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:29.890898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0d5d7-ba31-45b1-bbf6-f4e9cc4649f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:29.891779 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0d5d7-ba31-45b1-bbf6-f4e9cc4649f8 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:29.892306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0d5d7-ba31-45b1-bbf6-f4e9cc4649f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:29.894065 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e0d5d7-ba31-45b1-bbf6-f4e9cc4649f8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:29.899677 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 512/1008] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:29.906065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874fd19-9a7e-4582-bb0f-372d917c0bf0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:29.915890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874fd19-9a7e-4582-bb0f-372d917c0bf0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:29.921247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0284532-634e-4f7e-bfde-68da1619997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:29.922144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284532-634e-4f7e-bfde-68da1619997d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:29.922620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284532-634e-4f7e-bfde-68da1619997d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:29.923110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284532-634e-4f7e-bfde-68da1619997d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:29.924097 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0284532-634e-4f7e-bfde-68da1619997d admin admin] RBAC: Adding query filter params (interface=public, service_id=a7a238e25029471a8c673028cf9657b4, region_id=RegionOne) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:29.924602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0284532-634e-4f7e-bfde-68da1619997d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:29.926358 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0284532-634e-4f7e-bfde-68da1619997d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:29.931899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 497/1009] 10.222.0.90 () {56 vars in 1272 bytes} [Wed Feb 16 09:15:29 2022] GET /identity/v3/endpoints?service_id=a7a238e25029471a8c673028cf9657b4&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:29.937283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0d5d7-ba31-45b1-bbf6-f4e9cc4649f8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:29.947318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0d5d7-ba31-45b1-bbf6-f4e9cc4649f8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:29.952184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c98e2-9f31-425b-afd4-e175da2d35ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:29.953105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c98e2-9f31-425b-afd4-e175da2d35ec admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:29.953592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c98e2-9f31-425b-afd4-e175da2d35ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:29.954087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c98e2-9f31-425b-afd4-e175da2d35ec admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:29.954946 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c98e2-9f31-425b-afd4-e175da2d35ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:29.956740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c98e2-9f31-425b-afd4-e175da2d35ec admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:29.963971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 513/1010] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Feb 16 09:15:29 2022] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:15:30.426497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a5f72-708f-414b-83f0-e93fe1781e63 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:30.426904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a5f72-708f-414b-83f0-e93fe1781e63 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:30.427103 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a5f72-708f-414b-83f0-e93fe1781e63 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:30.429025 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 498/1011] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:30.433920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675e9d-9298-49bc-934d-bc8891d818bf None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:30.434278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675e9d-9298-49bc-934d-bc8891d818bf None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:30.434628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd675e9d-9298-49bc-934d-bc8891d818bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:30.453902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-fd675e9d-9298-49bc-934d-bc8891d818bf None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:30.455086 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fd675e9d-9298-49bc-934d-bc8891d818bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:30.462996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 514/1012] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:30 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:30.479271 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49849c8b-da14-4522-956a-b581d386d958 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:30.479560 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49849c8b-da14-4522-956a-b581d386d958 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:30.479838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49849c8b-da14-4522-956a-b581d386d958 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:30.481657 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 499/1013] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:30.486711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49849c8b-da14-4522-956a-b581d386d958 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:30.487217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08db03d-b639-44b2-9f2d-3c4c3cb1ad2f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:30.487507 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08db03d-b639-44b2-9f2d-3c4c3cb1ad2f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:30.487778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08db03d-b639-44b2-9f2d-3c4c3cb1ad2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:30.499012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49849c8b-da14-4522-956a-b581d386d958 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:30.503651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796adec-9abd-4803-92bf-def661bb4a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:30.504444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796adec-9abd-4803-92bf-def661bb4a09 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:30.504729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796adec-9abd-4803-92bf-def661bb4a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:30.505006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796adec-9abd-4803-92bf-def661bb4a09 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:30.505518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c08db03d-b639-44b2-9f2d-3c4c3cb1ad2f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:30.505679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796adec-9abd-4803-92bf-def661bb4a09 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:30.506691 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c08db03d-b639-44b2-9f2d-3c4c3cb1ad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:30.507223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796adec-9abd-4803-92bf-def661bb4a09 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:30.515284 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 515/1014] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:30 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:30.519180 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-7796adec-9abd-4803-92bf-def661bb4a09 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 16 09:15:30.524067 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 500/1015] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:30.525934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08db03d-b639-44b2-9f2d-3c4c3cb1ad2f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:30.535824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08db03d-b639-44b2-9f2d-3c4c3cb1ad2f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:30.540077 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796adec-9abd-4803-92bf-def661bb4a09 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:30.540356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb42abd-b9b1-40c4-b3f2-ea519d230613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:30.540988 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb42abd-b9b1-40c4-b3f2-ea519d230613 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:30.541271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb42abd-b9b1-40c4-b3f2-ea519d230613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:30.541540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb42abd-b9b1-40c4-b3f2-ea519d230613 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:30.542234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb42abd-b9b1-40c4-b3f2-ea519d230613 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:30.542538 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb42abd-b9b1-40c4-b3f2-ea519d230613 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:30.544135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb42abd-b9b1-40c4-b3f2-ea519d230613 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:30.549525 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 516/1016] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:30.549895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796adec-9abd-4803-92bf-def661bb4a09 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:30.554376 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc5d93-bb68-4bc4-ad2a-e944f61a15c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:30.554669 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb42abd-b9b1-40c4-b3f2-ea519d230613 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:30.555147 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5d93-bb68-4bc4-ad2a-e944f61a15c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:30.555427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5d93-bb68-4bc4-ad2a-e944f61a15c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:30.555700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5d93-bb68-4bc4-ad2a-e944f61a15c6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:30.556370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc5d93-bb68-4bc4-ad2a-e944f61a15c6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:30.557934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc5d93-bb68-4bc4-ad2a-e944f61a15c6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:30.564913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb42abd-b9b1-40c4-b3f2-ea519d230613 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:30.569343 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4df8a-5f9a-412e-adb1-9666857cd92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:30.569841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-ecdc5d93-bb68-4bc4-ad2a-e944f61a15c6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 09:15:30.569943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4df8a-5f9a-412e-adb1-9666857cd92d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:30.570227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4df8a-5f9a-412e-adb1-9666857cd92d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:30.570501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4df8a-5f9a-412e-adb1-9666857cd92d admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:30.571150 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 501/1017] 10.222.0.90 () {56 vars in 1147 bytes} [Wed Feb 16 09:15:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:30.571253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4df8a-5f9a-412e-adb1-9666857cd92d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:30.571473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4df8a-5f9a-412e-adb1-9666857cd92d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:30.573051 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4df8a-5f9a-412e-adb1-9666857cd92d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:30.576762 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc5d93-bb68-4bc4-ad2a-e944f61a15c6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:30.580168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 517/1018] 10.222.0.90 () {56 vars in 1133 bytes} [Wed Feb 16 09:15:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:30.584168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4df8a-5f9a-412e-adb1-9666857cd92d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:30.588744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc5d93-bb68-4bc4-ad2a-e944f61a15c6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:30.594025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4df8a-5f9a-412e-adb1-9666857cd92d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:30.594512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652a63c-e6ca-4dc8-ab69-8ba81ba9287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:30.595142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652a63c-e6ca-4dc8-ab69-8ba81ba9287e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:30.595422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652a63c-e6ca-4dc8-ab69-8ba81ba9287e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:30.595693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652a63c-e6ca-4dc8-ab69-8ba81ba9287e admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:30.596410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652a63c-e6ca-4dc8-ab69-8ba81ba9287e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:30.596710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652a63c-e6ca-4dc8-ab69-8ba81ba9287e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:30.598334 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652a63c-e6ca-4dc8-ab69-8ba81ba9287e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:30.598759 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0428e1-0d31-4a6f-b54c-6aa481e47e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:30.599375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0428e1-0d31-4a6f-b54c-6aa481e47e5a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:30.599654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0428e1-0d31-4a6f-b54c-6aa481e47e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:30.599931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0428e1-0d31-4a6f-b54c-6aa481e47e5a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:30.600675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0428e1-0d31-4a6f-b54c-6aa481e47e5a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:30.602230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0428e1-0d31-4a6f-b54c-6aa481e47e5a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:30.607801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 502/1019] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Feb 16 09:15:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:30.610027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652a63c-e6ca-4dc8-ab69-8ba81ba9287e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:30.620339 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652a63c-e6ca-4dc8-ab69-8ba81ba9287e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:30.628116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 518/1020] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Feb 16 09:15:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:15:30.643922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5756148-4a50-4bde-a2f0-10c7185f8a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:30.644627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5756148-4a50-4bde-a2f0-10c7185f8a58 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:30.644907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5756148-4a50-4bde-a2f0-10c7185f8a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:30.645179 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5756148-4a50-4bde-a2f0-10c7185f8a58 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:30.645888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5756148-4a50-4bde-a2f0-10c7185f8a58 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:30.646190 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5756148-4a50-4bde-a2f0-10c7185f8a58 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:30.647837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5756148-4a50-4bde-a2f0-10c7185f8a58 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:30.653382 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 503/1021] 10.222.0.90 () {56 vars in 1143 bytes} [Wed Feb 16 09:15:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:30.660553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0428e1-0d31-4a6f-b54c-6aa481e47e5a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:30.672052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0428e1-0d31-4a6f-b54c-6aa481e47e5a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:30.677323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa02ef9-0bf9-4608-a569-521258d78dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:30.678065 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02ef9-0bf9-4608-a569-521258d78dff admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:30.678463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02ef9-0bf9-4608-a569-521258d78dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:30.678808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02ef9-0bf9-4608-a569-521258d78dff admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:30.679626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa02ef9-0bf9-4608-a569-521258d78dff admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:30.681412 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa02ef9-0bf9-4608-a569-521258d78dff admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:30.699005 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 519/1022] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Feb 16 09:15:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:15:32.294098 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91570560-c0d9-4ef5-9823-7252e38ed46d None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:32.294600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91570560-c0d9-4ef5-9823-7252e38ed46d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:32.294828 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91570560-c0d9-4ef5-9823-7252e38ed46d None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:32.296653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 504/1023] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:32.301904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fa3a0-527f-4c25-ac51-9318d3cf60ba None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:32.302322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fa3a0-527f-4c25-ac51-9318d3cf60ba None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:32.302429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fa3a0-527f-4c25-ac51-9318d3cf60ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:32.320616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-377fa3a0-527f-4c25-ac51-9318d3cf60ba None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:32.321787 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-377fa3a0-527f-4c25-ac51-9318d3cf60ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:32.339883 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 520/1024] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:32 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:32.363892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91570560-c0d9-4ef5-9823-7252e38ed46d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:32.377002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91570560-c0d9-4ef5-9823-7252e38ed46d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:32.381363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f67d8-ae98-499c-9973-88113bd9a846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:32.382123 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f67d8-ae98-499c-9973-88113bd9a846 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:32.382399 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f67d8-ae98-499c-9973-88113bd9a846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:32.382670 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f67d8-ae98-499c-9973-88113bd9a846 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:32.383301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f67d8-ae98-499c-9973-88113bd9a846 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:32.384897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f67d8-ae98-499c-9973-88113bd9a846 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:32.396462 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-166f67d8-ae98-499c-9973-88113bd9a846 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 16 09:15:32.397621 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 505/1025] 10.222.0.90 () {56 vars in 1126 bytes} [Wed Feb 16 09:15:32 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:32.403463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fa3a0-527f-4c25-ac51-9318d3cf60ba None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:32.412818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fa3a0-527f-4c25-ac51-9318d3cf60ba None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:32.417371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31a4a1-8fd6-4e98-887f-3e1dae9ec46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:32.418088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a4a1-8fd6-4e98-887f-3e1dae9ec46b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:32.418439 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a4a1-8fd6-4e98-887f-3e1dae9ec46b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:32.418780 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31a4a1-8fd6-4e98-887f-3e1dae9ec46b admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:32.419547 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31a4a1-8fd6-4e98-887f-3e1dae9ec46b admin admin] RBAC: Adding query filter params (name=image) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:32.419922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31a4a1-8fd6-4e98-887f-3e1dae9ec46b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:32.421932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31a4a1-8fd6-4e98-887f-3e1dae9ec46b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:32.427132 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 521/1026] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:32.432986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f67d8-ae98-499c-9973-88113bd9a846 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:32.443773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f67d8-ae98-499c-9973-88113bd9a846 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:32.448382 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770808e-4c48-4904-b401-feb3d86a315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:32.449039 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770808e-4c48-4904-b401-feb3d86a315d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:32.449317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770808e-4c48-4904-b401-feb3d86a315d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:32.449589 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770808e-4c48-4904-b401-feb3d86a315d admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:32.450278 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770808e-4c48-4904-b401-feb3d86a315d admin admin] RBAC: Adding query filter params (type=image) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:32.450576 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770808e-4c48-4904-b401-feb3d86a315d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:32.453144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770808e-4c48-4904-b401-feb3d86a315d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:32.458334 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 506/1027] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:32.463740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31a4a1-8fd6-4e98-887f-3e1dae9ec46b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:32.473697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31a4a1-8fd6-4e98-887f-3e1dae9ec46b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:32.478108 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8632ad-99af-4c76-865c-d91195f28b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:32.478737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8632ad-99af-4c76-865c-d91195f28b7d admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:32.479012 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8632ad-99af-4c76-865c-d91195f28b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:32.479279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8632ad-99af-4c76-865c-d91195f28b7d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:32.480012 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8632ad-99af-4c76-865c-d91195f28b7d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:32.481613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8632ad-99af-4c76-865c-d91195f28b7d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:32.501639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 522/1028] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Feb 16 09:15:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:15:33.090181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63879c-97e2-495f-a628-2b2bf47d21a2 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.090527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63879c-97e2-495f-a628-2b2bf47d21a2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.090736 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63879c-97e2-495f-a628-2b2bf47d21a2 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.093250 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 507/1029] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:33.098505 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d12e4c-c85b-4edc-8e17-8b11de626134 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.098858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d12e4c-c85b-4edc-8e17-8b11de626134 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.099136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d12e4c-c85b-4edc-8e17-8b11de626134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.117285 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-26d12e4c-c85b-4edc-8e17-8b11de626134 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:33.118448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-26d12e4c-c85b-4edc-8e17-8b11de626134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:33.127746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edd1f-b68c-4ce9-bb80-bedaebfd5be3 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.128057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edd1f-b68c-4ce9-bb80-bedaebfd5be3 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.128343 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edd1f-b68c-4ce9-bb80-bedaebfd5be3 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.130253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 508/1030] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:15:33.134877 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c97e8-89be-4381-8e9c-e9b4650dbc8f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.135167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c97e8-89be-4381-8e9c-e9b4650dbc8f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.135449 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c97e8-89be-4381-8e9c-e9b4650dbc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.137158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 523/1031] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:33.156741 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-586c97e8-89be-4381-8e9c-e9b4650dbc8f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:33.157933 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-586c97e8-89be-4381-8e9c-e9b4650dbc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:33.162024 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d12e4c-c85b-4edc-8e17-8b11de626134 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.165818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 509/1032] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:33.172521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d12e4c-c85b-4edc-8e17-8b11de626134 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.177126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7eb6b-8654-4673-b331-7539c0eeff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.177901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7eb6b-8654-4673-b331-7539c0eeff55 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.178183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7eb6b-8654-4673-b331-7539c0eeff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.178458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7eb6b-8654-4673-b331-7539c0eeff55 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.179619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7eb6b-8654-4673-b331-7539c0eeff55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.181317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7eb6b-8654-4673-b331-7539c0eeff55 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.183008 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 524/1033] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:33.188894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c97e8-89be-4381-8e9c-e9b4650dbc8f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.190513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7eb6b-8654-4673-b331-7539c0eeff55 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.198516 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c97e8-89be-4381-8e9c-e9b4650dbc8f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.199893 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7eb6b-8654-4673-b331-7539c0eeff55 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.204162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18798eac-f727-403a-bfbd-bb9cfd151361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.204814 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18798eac-f727-403a-bfbd-bb9cfd151361 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.205094 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18798eac-f727-403a-bfbd-bb9cfd151361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.205277 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb59ef-3da1-4907-8308-1ad9f6b95e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.205385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18798eac-f727-403a-bfbd-bb9cfd151361 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.206013 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb59ef-3da1-4907-8308-1ad9f6b95e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.206109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18798eac-f727-403a-bfbd-bb9cfd151361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.206292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb59ef-3da1-4907-8308-1ad9f6b95e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.206562 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb59ef-3da1-4907-8308-1ad9f6b95e59 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.207946 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18798eac-f727-403a-bfbd-bb9cfd151361 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.217974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb59ef-3da1-4907-8308-1ad9f6b95e59 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:33.225752 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-c1bb59ef-3da1-4907-8308-1ad9f6b95e59 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 09:15:33.228058 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 525/1034] 10.222.0.90 () {56 vars in 1141 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:33.234092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb59ef-3da1-4907-8308-1ad9f6b95e59 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.244581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb59ef-3da1-4907-8308-1ad9f6b95e59 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.248411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 510/1035] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:15:33 2022] POST /identity/v3/projects => generated 311 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:15:33.309437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835f4d9-b4f4-4baf-bf62-567e542f0a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.310136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835f4d9-b4f4-4baf-bf62-567e542f0a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.310299 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835f4d9-b4f4-4baf-bf62-567e542f0a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.310571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835f4d9-b4f4-4baf-bf62-567e542f0a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.311991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835f4d9-b4f4-4baf-bf62-567e542f0a5c admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:33.312341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835f4d9-b4f4-4baf-bf62-567e542f0a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.313952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835f4d9-b4f4-4baf-bf62-567e542f0a5c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.328192 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 526/1036] 10.222.0.90 () {56 vars in 1136 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:33.329526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18798eac-f727-403a-bfbd-bb9cfd151361 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.340159 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18798eac-f727-403a-bfbd-bb9cfd151361 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.346081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161576-11ce-400c-94ba-f2374068dc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.346999 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161576-11ce-400c-94ba-f2374068dc4b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.347356 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161576-11ce-400c-94ba-f2374068dc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.347705 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161576-11ce-400c-94ba-f2374068dc4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.361315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb161576-11ce-400c-94ba-f2374068dc4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.363203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb161576-11ce-400c-94ba-f2374068dc4b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.380926 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-bb161576-11ce-400c-94ba-f2374068dc4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:33.382386 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 511/1037] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:33.388151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835f4d9-b4f4-4baf-bf62-567e542f0a5c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.399399 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835f4d9-b4f4-4baf-bf62-567e542f0a5c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.403979 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd2f8e-147d-4f15-9047-15e5f0dfed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.404697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2f8e-147d-4f15-9047-15e5f0dfed83 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.405651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2f8e-147d-4f15-9047-15e5f0dfed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.405982 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd2f8e-147d-4f15-9047-15e5f0dfed83 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.406774 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd2f8e-147d-4f15-9047-15e5f0dfed83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:33.407077 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd2f8e-147d-4f15-9047-15e5f0dfed83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.408720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd2f8e-147d-4f15-9047-15e5f0dfed83 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.426180 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 527/1038] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:33.426630 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161576-11ce-400c-94ba-f2374068dc4b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.437174 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161576-11ce-400c-94ba-f2374068dc4b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.442852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb78ec-5dba-4912-b355-5ac1797f775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.443888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb78ec-5dba-4912-b355-5ac1797f775c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.444332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb78ec-5dba-4912-b355-5ac1797f775c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.444681 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb78ec-5dba-4912-b355-5ac1797f775c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.454209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb78ec-5dba-4912-b355-5ac1797f775c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.456289 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb78ec-5dba-4912-b355-5ac1797f775c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.470281 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-cdcb78ec-5dba-4912-b355-5ac1797f775c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 09:15:33.471622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 512/1039] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:33.477245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd2f8e-147d-4f15-9047-15e5f0dfed83 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.487693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd2f8e-147d-4f15-9047-15e5f0dfed83 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.492441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87fdfb-a753-4d97-825c-a269a9d0bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.493109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87fdfb-a753-4d97-825c-a269a9d0bc3c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.493389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87fdfb-a753-4d97-825c-a269a9d0bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.493714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87fdfb-a753-4d97-825c-a269a9d0bc3c admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.494686 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87fdfb-a753-4d97-825c-a269a9d0bc3c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:33.494995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87fdfb-a753-4d97-825c-a269a9d0bc3c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.496867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87fdfb-a753-4d97-825c-a269a9d0bc3c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.515377 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 528/1040] 10.222.0.90 () {56 vars in 1154 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:33.521436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb78ec-5dba-4912-b355-5ac1797f775c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.532011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb78ec-5dba-4912-b355-5ac1797f775c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.536603 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5ad26-358c-47ee-99ea-f12d07984c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.537309 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5ad26-358c-47ee-99ea-f12d07984c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.537658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5ad26-358c-47ee-99ea-f12d07984c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.537999 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5ad26-358c-47ee-99ea-f12d07984c31 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.545972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5ad26-358c-47ee-99ea-f12d07984c31 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.547709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5ad26-358c-47ee-99ea-f12d07984c31 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.556894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 513/1041] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:15:33.563726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87fdfb-a753-4d97-825c-a269a9d0bc3c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.573302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87fdfb-a753-4d97-825c-a269a9d0bc3c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.578578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7934a2-4285-4e1a-b96e-d3915782a7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.579417 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7934a2-4285-4e1a-b96e-d3915782a7fe admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.579763 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7934a2-4285-4e1a-b96e-d3915782a7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.580161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7934a2-4285-4e1a-b96e-d3915782a7fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.590460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7934a2-4285-4e1a-b96e-d3915782a7fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.592924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7934a2-4285-4e1a-b96e-d3915782a7fe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.610683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-7d7934a2-4285-4e1a-b96e-d3915782a7fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:33.616530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 529/1042] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:33.618031 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5ad26-358c-47ee-99ea-f12d07984c31 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.627783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5ad26-358c-47ee-99ea-f12d07984c31 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.632436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e315-3a69-4ce1-be85-c768fd07023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.633154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e315-3a69-4ce1-be85-c768fd07023d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.633528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e315-3a69-4ce1-be85-c768fd07023d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.633871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08e315-3a69-4ce1-be85-c768fd07023d admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.634641 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e315-3a69-4ce1-be85-c768fd07023d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:33.635015 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e315-3a69-4ce1-be85-c768fd07023d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.636695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08e315-3a69-4ce1-be85-c768fd07023d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.651602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 514/1043] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:33.657571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7934a2-4285-4e1a-b96e-d3915782a7fe admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.667366 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7934a2-4285-4e1a-b96e-d3915782a7fe admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.671905 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b45286-ff13-4843-b5f9-09ac759cce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.672852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b45286-ff13-4843-b5f9-09ac759cce2c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.673486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b45286-ff13-4843-b5f9-09ac759cce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.673771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b45286-ff13-4843-b5f9-09ac759cce2c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.681365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b45286-ff13-4843-b5f9-09ac759cce2c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.683357 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b45286-ff13-4843-b5f9-09ac759cce2c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.698085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-40b45286-ff13-4843-b5f9-09ac759cce2c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:33.699457 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 530/1044] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:33.706180 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e315-3a69-4ce1-be85-c768fd07023d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.715963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08e315-3a69-4ce1-be85-c768fd07023d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.720611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10531c11-6bda-44ca-ad01-6a385655b802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.721260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10531c11-6bda-44ca-ad01-6a385655b802 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.721545 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10531c11-6bda-44ca-ad01-6a385655b802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.721822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10531c11-6bda-44ca-ad01-6a385655b802 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.722607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10531c11-6bda-44ca-ad01-6a385655b802 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:33.722915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10531c11-6bda-44ca-ad01-6a385655b802 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.724781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10531c11-6bda-44ca-ad01-6a385655b802 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.736424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 515/1045] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:33.742572 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b45286-ff13-4843-b5f9-09ac759cce2c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:33.753808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b45286-ff13-4843-b5f9-09ac759cce2c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:33.758280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ad055-2d37-4392-babb-d6b7142adaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:33.758972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad055-2d37-4392-babb-d6b7142adaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:33.759255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad055-2d37-4392-babb-d6b7142adaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:33.759525 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad055-2d37-4392-babb-d6b7142adaa7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:33.760372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ad055-2d37-4392-babb-d6b7142adaa7 admin admin] RBAC: Adding query filter params (role.id=6b4e412de235405e8eff8775eca34b6b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=9801d0694ec54d65bdd5b8914e05637e) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:33.760680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ad055-2d37-4392-babb-d6b7142adaa7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:33.762518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ad055-2d37-4392-babb-d6b7142adaa7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:33.769095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 531/1046] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:33 2022] GET /identity/v3/role_assignments?user.id=9801d0694ec54d65bdd5b8914e05637e&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=6b4e412de235405e8eff8775eca34b6b => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:34.866883 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2611-9d46-4c00-b13c-599b90fbf020 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:34.867461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2611-9d46-4c00-b13c-599b90fbf020 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:34.867461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f2611-9d46-4c00-b13c-599b90fbf020 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:34.869393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 516/1047] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:34.875278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e3ce6-50f8-4499-ad07-b4242d199204 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:34.875762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e3ce6-50f8-4499-ad07-b4242d199204 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:34.875839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e3ce6-50f8-4499-ad07-b4242d199204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:34.894506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-759e3ce6-50f8-4499-ad07-b4242d199204 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:34.895705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-759e3ce6-50f8-4499-ad07-b4242d199204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:34.904700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 532/1048] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:34.928084 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f2611-9d46-4c00-b13c-599b90fbf020 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:34.941405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f2611-9d46-4c00-b13c-599b90fbf020 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:34.945928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1fa1-b696-4767-8c08-1399ad5825fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:34.946561 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1fa1-b696-4767-8c08-1399ad5825fa admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:34.946843 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1fa1-b696-4767-8c08-1399ad5825fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:34.947120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1fa1-b696-4767-8c08-1399ad5825fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:34.955974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1fa1-b696-4767-8c08-1399ad5825fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:34.957769 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1fa1-b696-4767-8c08-1399ad5825fa admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:34.966788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 517/1049] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:34 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:15:34.973351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e3ce6-50f8-4499-ad07-b4242d199204 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:34.982461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e3ce6-50f8-4499-ad07-b4242d199204 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:34.987082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d25281-01ec-4e33-80fe-2095f63358c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:34.987932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d25281-01ec-4e33-80fe-2095f63358c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:34.988362 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d25281-01ec-4e33-80fe-2095f63358c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:34.988706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d25281-01ec-4e33-80fe-2095f63358c3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:34.989965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d25281-01ec-4e33-80fe-2095f63358c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:34.991716 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d25281-01ec-4e33-80fe-2095f63358c3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:34.993568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 533/1050] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:35.698512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f3642-7c00-465c-b1f5-47fcb5da2be9 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:35.698799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f3642-7c00-465c-b1f5-47fcb5da2be9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:35.699072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f3642-7c00-465c-b1f5-47fcb5da2be9 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:35.700938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 518/1051] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:35.707786 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b0b2e-a48a-4a2f-a0ce-1a68827f82a5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:35.708105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b0b2e-a48a-4a2f-a0ce-1a68827f82a5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:35.708388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b0b2e-a48a-4a2f-a0ce-1a68827f82a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:35.728477 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-aa0b0b2e-a48a-4a2f-a0ce-1a68827f82a5 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:35.729681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-aa0b0b2e-a48a-4a2f-a0ce-1a68827f82a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:35.737429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 534/1052] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:35.762420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f3642-7c00-465c-b1f5-47fcb5da2be9 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:35.775736 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f3642-7c00-465c-b1f5-47fcb5da2be9 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:35.780766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd4791-ba35-47e3-bdec-fb33e6b9727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:35.781529 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd4791-ba35-47e3-bdec-fb33e6b9727b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:35.781812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd4791-ba35-47e3-bdec-fb33e6b9727b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:35.782089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd4791-ba35-47e3-bdec-fb33e6b9727b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:35.783247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd4791-ba35-47e3-bdec-fb33e6b9727b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:35.784950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd4791-ba35-47e3-bdec-fb33e6b9727b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:35.786688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 519/1053] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:35.792195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b0b2e-a48a-4a2f-a0ce-1a68827f82a5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:35.801543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b0b2e-a48a-4a2f-a0ce-1a68827f82a5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:35.806131 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1e39d-4389-4ea2-84ea-b68a0b213590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:35.806786 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1e39d-4389-4ea2-84ea-b68a0b213590 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:35.807066 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1e39d-4389-4ea2-84ea-b68a0b213590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:35.807340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1e39d-4389-4ea2-84ea-b68a0b213590 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:35.808067 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1e39d-4389-4ea2-84ea-b68a0b213590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:35.809987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1e39d-4389-4ea2-84ea-b68a0b213590 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:35.831223 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 535/1054] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:15:35 2022] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:15:36.063014 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18e5b5-531f-434e-9639-862015d6731b None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.063535 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18e5b5-531f-434e-9639-862015d6731b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.063535 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18e5b5-531f-434e-9639-862015d6731b None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.065350 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 520/1055] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:36.070884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aeccc-9837-4899-880f-fb3f3439d43f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.071336 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aeccc-9837-4899-880f-fb3f3439d43f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.071448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aeccc-9837-4899-880f-fb3f3439d43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.089771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c68aeccc-9837-4899-880f-fb3f3439d43f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:36.090942 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c68aeccc-9837-4899-880f-fb3f3439d43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:36.098712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 536/1056] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:36.121480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18e5b5-531f-434e-9639-862015d6731b None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:36.134131 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18e5b5-531f-434e-9639-862015d6731b None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:36.138505 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa996d-ab51-4724-862c-f93b82255349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:36.140161 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa996d-ab51-4724-862c-f93b82255349 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.140448 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa996d-ab51-4724-862c-f93b82255349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.140723 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa996d-ab51-4724-862c-f93b82255349 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.151472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa996d-ab51-4724-862c-f93b82255349 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:36.158810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-b5fa996d-ab51-4724-862c-f93b82255349 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 09:15:36.159982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 521/1057] 10.222.0.90 () {56 vars in 1141 bytes} [Wed Feb 16 09:15:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:36.166088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aeccc-9837-4899-880f-fb3f3439d43f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:36.175150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aeccc-9837-4899-880f-fb3f3439d43f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:36.179696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6e7eb-5cc6-429d-b503-c67a4693c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:36.180377 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6e7eb-5cc6-429d-b503-c67a4693c9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.180665 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6e7eb-5cc6-429d-b503-c67a4693c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.180937 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6e7eb-5cc6-429d-b503-c67a4693c9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.181675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6e7eb-5cc6-429d-b503-c67a4693c9f2 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:36.181979 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6e7eb-5cc6-429d-b503-c67a4693c9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:36.183559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6e7eb-5cc6-429d-b503-c67a4693c9f2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:36.192121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 537/1058] 10.222.0.90 () {56 vars in 1136 bytes} [Wed Feb 16 09:15:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:36.197800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa996d-ab51-4724-862c-f93b82255349 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:36.208202 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa996d-ab51-4724-862c-f93b82255349 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:36.212720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4529ee0-3888-4ebc-9f8d-c5eed6c1213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:36.213510 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4529ee0-3888-4ebc-9f8d-c5eed6c1213f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.213790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4529ee0-3888-4ebc-9f8d-c5eed6c1213f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.214059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4529ee0-3888-4ebc-9f8d-c5eed6c1213f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.224084 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4529ee0-3888-4ebc-9f8d-c5eed6c1213f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:36.225929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4529ee0-3888-4ebc-9f8d-c5eed6c1213f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:36.242778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-c4529ee0-3888-4ebc-9f8d-c5eed6c1213f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:36.243941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 522/1059] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:36.250624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6e7eb-5cc6-429d-b503-c67a4693c9f2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:36.260129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6e7eb-5cc6-429d-b503-c67a4693c9f2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:36.264951 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0e1e3-1f0c-4441-9be2-e28f866424b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:36.265545 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0e1e3-1f0c-4441-9be2-e28f866424b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.266092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0e1e3-1f0c-4441-9be2-e28f866424b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.266367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0e1e3-1f0c-4441-9be2-e28f866424b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.267080 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0e1e3-1f0c-4441-9be2-e28f866424b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:36.267387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0e1e3-1f0c-4441-9be2-e28f866424b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:36.269004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0e1e3-1f0c-4441-9be2-e28f866424b6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:36.280657 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 538/1060] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:36.286173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4529ee0-3888-4ebc-9f8d-c5eed6c1213f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:36.296495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4529ee0-3888-4ebc-9f8d-c5eed6c1213f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:36.301030 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93074d70-8c06-48e4-bb5c-4e501ab871f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:36.301800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93074d70-8c06-48e4-bb5c-4e501ab871f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.302079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93074d70-8c06-48e4-bb5c-4e501ab871f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.302351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93074d70-8c06-48e4-bb5c-4e501ab871f8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.309384 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93074d70-8c06-48e4-bb5c-4e501ab871f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:36.312366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93074d70-8c06-48e4-bb5c-4e501ab871f8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:36.325558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-93074d70-8c06-48e4-bb5c-4e501ab871f8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 09:15:36.331223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 523/1061] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Feb 16 09:15:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:36.332392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0e1e3-1f0c-4441-9be2-e28f866424b6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:36.341845 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0e1e3-1f0c-4441-9be2-e28f866424b6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:36.346682 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e4f3d-b45a-49a6-b1ef-da47de2dbd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:36.347322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e4f3d-b45a-49a6-b1ef-da47de2dbd56 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.347599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e4f3d-b45a-49a6-b1ef-da47de2dbd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.347876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e4f3d-b45a-49a6-b1ef-da47de2dbd56 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.348724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e4f3d-b45a-49a6-b1ef-da47de2dbd56 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:36.349030 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e4f3d-b45a-49a6-b1ef-da47de2dbd56 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:36.350836 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e4f3d-b45a-49a6-b1ef-da47de2dbd56 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:36.368096 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 539/1062] 10.222.0.90 () {56 vars in 1154 bytes} [Wed Feb 16 09:15:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:36.374090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93074d70-8c06-48e4-bb5c-4e501ab871f8 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:36.383849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93074d70-8c06-48e4-bb5c-4e501ab871f8 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:36.388312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03e28-681a-4113-8133-b6e08b2c7d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:36.389118 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03e28-681a-4113-8133-b6e08b2c7d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.389513 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03e28-681a-4113-8133-b6e08b2c7d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.389993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd03e28-681a-4113-8133-b6e08b2c7d90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.400183 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd03e28-681a-4113-8133-b6e08b2c7d90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:36.401990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd03e28-681a-4113-8133-b6e08b2c7d90 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:36.418506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-8dd03e28-681a-4113-8133-b6e08b2c7d90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:36.419631 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 524/1063] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:36.425875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e4f3d-b45a-49a6-b1ef-da47de2dbd56 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:36.435312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e4f3d-b45a-49a6-b1ef-da47de2dbd56 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:36.440664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a6db0-627e-4ad8-aa73-5ca1bfcb1fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:36.441298 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a6db0-627e-4ad8-aa73-5ca1bfcb1fae admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.441579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a6db0-627e-4ad8-aa73-5ca1bfcb1fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.441852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a6db0-627e-4ad8-aa73-5ca1bfcb1fae admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.442559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a6db0-627e-4ad8-aa73-5ca1bfcb1fae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:36.442863 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a6db0-627e-4ad8-aa73-5ca1bfcb1fae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:36.444471 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a6db0-627e-4ad8-aa73-5ca1bfcb1fae admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:36.456050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 540/1064] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:36.461687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03e28-681a-4113-8133-b6e08b2c7d90 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:36.471667 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd03e28-681a-4113-8133-b6e08b2c7d90 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:36.476234 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12e629-0d5f-4dca-ab49-ed078abd78ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:36.476994 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12e629-0d5f-4dca-ab49-ed078abd78ff admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.477401 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12e629-0d5f-4dca-ab49-ed078abd78ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.477673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12e629-0d5f-4dca-ab49-ed078abd78ff admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.485167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12e629-0d5f-4dca-ab49-ed078abd78ff admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:36.487101 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a12e629-0d5f-4dca-ab49-ed078abd78ff admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:36.500733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-0a12e629-0d5f-4dca-ab49-ed078abd78ff admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:36.501985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 525/1065] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:36.507416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a6db0-627e-4ad8-aa73-5ca1bfcb1fae admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:36.517240 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a6db0-627e-4ad8-aa73-5ca1bfcb1fae admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:36.521686 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809ba28-8db7-4fac-8fa6-3b83af0a573d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:36.522406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ba28-8db7-4fac-8fa6-3b83af0a573d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.522753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ba28-8db7-4fac-8fa6-3b83af0a573d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.523088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ba28-8db7-4fac-8fa6-3b83af0a573d admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.523921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809ba28-8db7-4fac-8fa6-3b83af0a573d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:36.524314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809ba28-8db7-4fac-8fa6-3b83af0a573d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:36.526179 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809ba28-8db7-4fac-8fa6-3b83af0a573d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:36.537931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 541/1066] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:36.543791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12e629-0d5f-4dca-ab49-ed078abd78ff admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:36.554821 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12e629-0d5f-4dca-ab49-ed078abd78ff admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:36.559290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb74618-7a72-4fd8-ab22-d6c736120ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:36.560170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb74618-7a72-4fd8-ab22-d6c736120ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:36.560447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb74618-7a72-4fd8-ab22-d6c736120ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:36.560717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb74618-7a72-4fd8-ab22-d6c736120ef1 admin admin] PATH_INFO: `/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/9801d0694ec54d65bdd5b8914e05637e/roles/6b4e412de235405e8eff8775eca34b6b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:36.563657 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb74618-7a72-4fd8-ab22-d6c736120ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ab51e6e2745658b252fbafdc2f8ef, user_id=9801d0694ec54d65bdd5b8914e05637e, role_id=6b4e412de235405e8eff8775eca34b6b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:36.566299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb74618-7a72-4fd8-ab22-d6c736120ef1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:36.580480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 526/1067] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:15:36 2022] PUT /identity/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/9801d0694ec54d65bdd5b8914e05637e/roles/6b4e412de235405e8eff8775eca34b6b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:15:38.265645 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112382ab-d49d-4649-b466-a811c4efb485 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:38.266524 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112382ab-d49d-4649-b466-a811c4efb485 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:38.266524 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112382ab-d49d-4649-b466-a811c4efb485 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:38.268243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 542/1068] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:38.273615 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d2305-7287-494b-aaff-9953c65480f4 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:38.274058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d2305-7287-494b-aaff-9953c65480f4 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:38.274157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d2305-7287-494b-aaff-9953c65480f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:38.291713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-487d2305-7287-494b-aaff-9953c65480f4 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:38.292901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-487d2305-7287-494b-aaff-9953c65480f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:38.348890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 527/1069] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:38.373943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112382ab-d49d-4649-b466-a811c4efb485 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:38.385943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112382ab-d49d-4649-b466-a811c4efb485 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:38.390709 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb31782-2e59-4080-b876-5ddb48d6581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:38.391736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb31782-2e59-4080-b876-5ddb48d6581a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:38.392015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb31782-2e59-4080-b876-5ddb48d6581a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:38.392316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb31782-2e59-4080-b876-5ddb48d6581a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:38.402321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb31782-2e59-4080-b876-5ddb48d6581a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:38.410049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-aeb31782-2e59-4080-b876-5ddb48d6581a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:15:38.411226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 543/1070] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:38.417187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d2305-7287-494b-aaff-9953c65480f4 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:38.426846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d2305-7287-494b-aaff-9953c65480f4 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:38.431349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70793f-dc0b-45aa-a408-0df53e27d6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:38.431997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70793f-dc0b-45aa-a408-0df53e27d6ca admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:38.432323 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70793f-dc0b-45aa-a408-0df53e27d6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:38.432597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70793f-dc0b-45aa-a408-0df53e27d6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:38.433333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70793f-dc0b-45aa-a408-0df53e27d6ca admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:38.433635 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70793f-dc0b-45aa-a408-0df53e27d6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:38.435228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70793f-dc0b-45aa-a408-0df53e27d6ca admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:38.443511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 528/1071] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:15:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:38.449293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb31782-2e59-4080-b876-5ddb48d6581a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:38.460573 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb31782-2e59-4080-b876-5ddb48d6581a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:38.465029 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cb8a8-e3f9-425c-9731-fefd906f6499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:38.465887 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cb8a8-e3f9-425c-9731-fefd906f6499 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:38.466171 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cb8a8-e3f9-425c-9731-fefd906f6499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:38.466450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cb8a8-e3f9-425c-9731-fefd906f6499 admin admin] PATH_INFO: `/v3/users/5f5c55ee0df7450289d6d57df99f1449` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:38.480400 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cb8a8-e3f9-425c-9731-fefd906f6499 admin admin] RBAC: Authorizing `identity:get_user(user_id=5f5c55ee0df7450289d6d57df99f1449)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:38.482521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cb8a8-e3f9-425c-9731-fefd906f6499 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:38.484778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 544/1072] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:15:38 2022] GET /identity/v3/users/5f5c55ee0df7450289d6d57df99f1449 => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:38.490562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70793f-dc0b-45aa-a408-0df53e27d6ca admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:38.500336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70793f-dc0b-45aa-a408-0df53e27d6ca admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:38.504853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ab755-adec-4b34-a0e7-95bab68ee798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:38.505559 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ab755-adec-4b34-a0e7-95bab68ee798 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:38.505906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ab755-adec-4b34-a0e7-95bab68ee798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:38.506247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ab755-adec-4b34-a0e7-95bab68ee798 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:38.515675 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ab755-adec-4b34-a0e7-95bab68ee798 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:38.517783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ab755-adec-4b34-a0e7-95bab68ee798 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:38.527918 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 529/1073] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:38 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:15:38.534976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cb8a8-e3f9-425c-9731-fefd906f6499 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:38.544725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cb8a8-e3f9-425c-9731-fefd906f6499 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:38.549414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104dc3b-e60a-4122-95eb-6dcacbe6ec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:38.550253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104dc3b-e60a-4122-95eb-6dcacbe6ec8d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:38.550529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104dc3b-e60a-4122-95eb-6dcacbe6ec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:38.550797 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104dc3b-e60a-4122-95eb-6dcacbe6ec8d admin admin] PATH_INFO: `/v3/projects/6ff27c883df246d6bc67ec4aeccc898d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:38.551941 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104dc3b-e60a-4122-95eb-6dcacbe6ec8d admin admin] RBAC: Authorizing `identity:get_project(project_id=6ff27c883df246d6bc67ec4aeccc898d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:38.553996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5104dc3b-e60a-4122-95eb-6dcacbe6ec8d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:38.555643 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 545/1074] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:15:38 2022] GET /identity/v3/projects/6ff27c883df246d6bc67ec4aeccc898d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:38.561686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ab755-adec-4b34-a0e7-95bab68ee798 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:38.570792 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ab755-adec-4b34-a0e7-95bab68ee798 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:38.575242 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c35d6-a21d-40c3-92fd-36f1920ab326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:38.575870 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c35d6-a21d-40c3-92fd-36f1920ab326 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:38.576183 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c35d6-a21d-40c3-92fd-36f1920ab326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:38.576452 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c35d6-a21d-40c3-92fd-36f1920ab326 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:38.577788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c35d6-a21d-40c3-92fd-36f1920ab326 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=6ff27c883df246d6bc67ec4aeccc898d, user.id=5f5c55ee0df7450289d6d57df99f1449) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:38.578085 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c35d6-a21d-40c3-92fd-36f1920ab326 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:38.579906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c35d6-a21d-40c3-92fd-36f1920ab326 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:38.585351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 530/1075] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:38 2022] GET /identity/v3/role_assignments?user.id=5f5c55ee0df7450289d6d57df99f1449&scope.project.id=6ff27c883df246d6bc67ec4aeccc898d&role.id=0e45946c6336419abb2015d8916e31ca => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:38.884387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351d92c-43b0-43e4-b623-a35cb28302bd None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:38.884675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351d92c-43b0-43e4-b623-a35cb28302bd None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:38.884957 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351d92c-43b0-43e4-b623-a35cb28302bd None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:38.886740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 546/1076] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:38.893186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2daf0b-af6d-435c-9c3b-fdb6c8d2f179 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:38.893568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2daf0b-af6d-435c-9c3b-fdb6c8d2f179 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:38.893856 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2daf0b-af6d-435c-9c3b-fdb6c8d2f179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:38.911127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0c2daf0b-af6d-435c-9c3b-fdb6c8d2f179 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:38.912333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0c2daf0b-af6d-435c-9c3b-fdb6c8d2f179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:38.919933 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 531/1077] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:38.944157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351d92c-43b0-43e4-b623-a35cb28302bd None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:38.956552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351d92c-43b0-43e4-b623-a35cb28302bd None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:38.960852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc876a-50cb-4879-90b3-c6d23356df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:38.961632 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc876a-50cb-4879-90b3-c6d23356df64 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:38.961911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc876a-50cb-4879-90b3-c6d23356df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:38.962186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc876a-50cb-4879-90b3-c6d23356df64 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:38.973035 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc876a-50cb-4879-90b3-c6d23356df64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:38.980193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-3ebc876a-50cb-4879-90b3-c6d23356df64 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 09:15:38.981380 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 547/1078] 10.222.0.90 () {56 vars in 1141 bytes} [Wed Feb 16 09:15:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:38.988067 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2daf0b-af6d-435c-9c3b-fdb6c8d2f179 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:38.997115 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2daf0b-af6d-435c-9c3b-fdb6c8d2f179 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:39.001977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab5197-7cfb-45d4-8478-f4fdceeb8e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:39.002719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab5197-7cfb-45d4-8478-f4fdceeb8e64 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:39.003003 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab5197-7cfb-45d4-8478-f4fdceeb8e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:39.003277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab5197-7cfb-45d4-8478-f4fdceeb8e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:39.004017 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab5197-7cfb-45d4-8478-f4fdceeb8e64 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:39.004343 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab5197-7cfb-45d4-8478-f4fdceeb8e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:39.005943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab5197-7cfb-45d4-8478-f4fdceeb8e64 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:39.018833 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 532/1079] 10.222.0.90 () {56 vars in 1136 bytes} [Wed Feb 16 09:15:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:39.020315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc876a-50cb-4879-90b3-c6d23356df64 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:39.031239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc876a-50cb-4879-90b3-c6d23356df64 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:39.039036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffac287-6cec-4a02-b094-31bd36ded2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:39.039801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffac287-6cec-4a02-b094-31bd36ded2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:39.040109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffac287-6cec-4a02-b094-31bd36ded2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:39.040382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffac287-6cec-4a02-b094-31bd36ded2f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:39.051471 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffac287-6cec-4a02-b094-31bd36ded2f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:39.053314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffac287-6cec-4a02-b094-31bd36ded2f4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:39.075228 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-6ffac287-6cec-4a02-b094-31bd36ded2f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:39.077015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 548/1080] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:39.084921 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab5197-7cfb-45d4-8478-f4fdceeb8e64 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:39.096456 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab5197-7cfb-45d4-8478-f4fdceeb8e64 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:39.103608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20549291-1945-42b4-8c0d-3eb33b6b9b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:39.104535 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20549291-1945-42b4-8c0d-3eb33b6b9b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:39.104813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20549291-1945-42b4-8c0d-3eb33b6b9b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:39.105084 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20549291-1945-42b4-8c0d-3eb33b6b9b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:39.105798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20549291-1945-42b4-8c0d-3eb33b6b9b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:39.106097 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20549291-1945-42b4-8c0d-3eb33b6b9b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:39.107801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20549291-1945-42b4-8c0d-3eb33b6b9b73 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:39.120477 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 533/1081] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:39.127079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffac287-6cec-4a02-b094-31bd36ded2f4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:39.136613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffac287-6cec-4a02-b094-31bd36ded2f4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:39.141888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1600b8-782b-46b0-ac50-71eff3795385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:39.142646 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1600b8-782b-46b0-ac50-71eff3795385 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:39.142927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1600b8-782b-46b0-ac50-71eff3795385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:39.143199 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1600b8-782b-46b0-ac50-71eff3795385 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:39.150284 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1600b8-782b-46b0-ac50-71eff3795385 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:39.152294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1600b8-782b-46b0-ac50-71eff3795385 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:39.166543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-fb1600b8-782b-46b0-ac50-71eff3795385 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 09:15:39.167666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 549/1082] 10.222.0.90 () {56 vars in 1114 bytes} [Wed Feb 16 09:15:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:15:39.174218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20549291-1945-42b4-8c0d-3eb33b6b9b73 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:39.183793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20549291-1945-42b4-8c0d-3eb33b6b9b73 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:39.189323 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddadc29-7ad4-4051-ad4e-f65f23a7918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:39.190055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddadc29-7ad4-4051-ad4e-f65f23a7918d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:39.190402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddadc29-7ad4-4051-ad4e-f65f23a7918d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:39.190744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddadc29-7ad4-4051-ad4e-f65f23a7918d admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:39.191571 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddadc29-7ad4-4051-ad4e-f65f23a7918d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:39.191876 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddadc29-7ad4-4051-ad4e-f65f23a7918d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:39.193744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddadc29-7ad4-4051-ad4e-f65f23a7918d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:39.211352 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 534/1083] 10.222.0.90 () {56 vars in 1154 bytes} [Wed Feb 16 09:15:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:39.216992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1600b8-782b-46b0-ac50-71eff3795385 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:39.226496 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1600b8-782b-46b0-ac50-71eff3795385 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:39.230888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde150c-8c54-4113-b651-081014449a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:39.231501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde150c-8c54-4113-b651-081014449a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:39.231776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde150c-8c54-4113-b651-081014449a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:39.232068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde150c-8c54-4113-b651-081014449a78 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:39.240754 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde150c-8c54-4113-b651-081014449a78 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:39.242527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde150c-8c54-4113-b651-081014449a78 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:39.251966 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 550/1084] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:39 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:15:39.257775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddadc29-7ad4-4051-ad4e-f65f23a7918d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:39.267643 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddadc29-7ad4-4051-ad4e-f65f23a7918d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:39.272146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e082e-24fb-4d69-ad55-f50ddd4ef169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:39.272925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e082e-24fb-4d69-ad55-f50ddd4ef169 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:39.273210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e082e-24fb-4d69-ad55-f50ddd4ef169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:39.273488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e082e-24fb-4d69-ad55-f50ddd4ef169 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:39.283600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e082e-24fb-4d69-ad55-f50ddd4ef169 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:39.285465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e082e-24fb-4d69-ad55-f50ddd4ef169 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:39.302312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-898e082e-24fb-4d69-ad55-f50ddd4ef169 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:15:39.303634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 535/1085] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:39.309281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde150c-8c54-4113-b651-081014449a78 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:39.318787 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde150c-8c54-4113-b651-081014449a78 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:39.323495 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58c83-f842-4b05-94fc-37f89f0f388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:39.324278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58c83-f842-4b05-94fc-37f89f0f388c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:39.324561 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58c83-f842-4b05-94fc-37f89f0f388c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:39.324835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58c83-f842-4b05-94fc-37f89f0f388c admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:39.325546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc58c83-f842-4b05-94fc-37f89f0f388c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:39.325852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc58c83-f842-4b05-94fc-37f89f0f388c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:39.327695 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc58c83-f842-4b05-94fc-37f89f0f388c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:39.338923 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 551/1086] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:39.345005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e082e-24fb-4d69-ad55-f50ddd4ef169 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:39.354855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e082e-24fb-4d69-ad55-f50ddd4ef169 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:39.360267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c152-e1a1-40f6-8ba8-1ccd420d4ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:39.361035 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c152-e1a1-40f6-8ba8-1ccd420d4ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:39.361314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c152-e1a1-40f6-8ba8-1ccd420d4ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:39.361588 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c152-e1a1-40f6-8ba8-1ccd420d4ba5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:39.368372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161c152-e1a1-40f6-8ba8-1ccd420d4ba5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:39.370319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161c152-e1a1-40f6-8ba8-1ccd420d4ba5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:39.383781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-b161c152-e1a1-40f6-8ba8-1ccd420d4ba5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:15:39.384985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 536/1087] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:15:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:39.391623 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58c83-f842-4b05-94fc-37f89f0f388c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:39.402113 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58c83-f842-4b05-94fc-37f89f0f388c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:39.407028 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5f4d1-a65d-4c09-b8c8-67079b30f599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:39.407739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5f4d1-a65d-4c09-b8c8-67079b30f599 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:39.408112 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5f4d1-a65d-4c09-b8c8-67079b30f599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:39.408447 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5f4d1-a65d-4c09-b8c8-67079b30f599 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:39.409285 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5f4d1-a65d-4c09-b8c8-67079b30f599 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:39.409658 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5f4d1-a65d-4c09-b8c8-67079b30f599 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:39.411559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5f4d1-a65d-4c09-b8c8-67079b30f599 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:39.424688 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 552/1088] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:15:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:39.430723 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c152-e1a1-40f6-8ba8-1ccd420d4ba5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:39.442955 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c152-e1a1-40f6-8ba8-1ccd420d4ba5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:39.447478 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b5b86-33d4-4fe9-bd1f-ee4c9d0d5ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:39.448136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b5b86-33d4-4fe9-bd1f-ee4c9d0d5ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:39.448415 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b5b86-33d4-4fe9-bd1f-ee4c9d0d5ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:39.448685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b5b86-33d4-4fe9-bd1f-ee4c9d0d5ad9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:39.449503 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b5b86-33d4-4fe9-bd1f-ee4c9d0d5ad9 admin admin] RBAC: Adding query filter params (role.id=6b4e412de235405e8eff8775eca34b6b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=9801d0694ec54d65bdd5b8914e05637e) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:39.449807 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b5b86-33d4-4fe9-bd1f-ee4c9d0d5ad9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:39.451786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b5b86-33d4-4fe9-bd1f-ee4c9d0d5ad9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:39.457608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 537/1089] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:39 2022] GET /identity/v3/role_assignments?user.id=9801d0694ec54d65bdd5b8914e05637e&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=6b4e412de235405e8eff8775eca34b6b => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:40.914261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78862e-42f9-499c-a570-c8aff5a1666f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:40.914836 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78862e-42f9-499c-a570-c8aff5a1666f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:40.914836 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78862e-42f9-499c-a570-c8aff5a1666f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:40.916613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 553/1090] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:40.922314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f40e1-ff12-4e13-becf-1ed8bed35bfb None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:40.922753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f40e1-ff12-4e13-becf-1ed8bed35bfb None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:40.922860 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f40e1-ff12-4e13-becf-1ed8bed35bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:40.940357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-fa0f40e1-ff12-4e13-becf-1ed8bed35bfb None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:40.941508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-fa0f40e1-ff12-4e13-becf-1ed8bed35bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:40.948994 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 538/1091] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:40.973113 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78862e-42f9-499c-a570-c8aff5a1666f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:40.987964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78862e-42f9-499c-a570-c8aff5a1666f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:40.992345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1befe2-5bca-44be-b91f-a00e764c4068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:40.993108 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1befe2-5bca-44be-b91f-a00e764c4068 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:40.993387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1befe2-5bca-44be-b91f-a00e764c4068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:40.993659 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1befe2-5bca-44be-b91f-a00e764c4068 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:41.004333 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1befe2-5bca-44be-b91f-a00e764c4068 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:41.010987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-5c1befe2-5bca-44be-b91f-a00e764c4068 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:15:41.012328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 554/1092] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:41.019404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f40e1-ff12-4e13-becf-1ed8bed35bfb None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:41.028188 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f40e1-ff12-4e13-becf-1ed8bed35bfb None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:41.033399 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e78cf-3555-451a-a1ef-e4993cbb03f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:41.034047 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e78cf-3555-451a-a1ef-e4993cbb03f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:41.034317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e78cf-3555-451a-a1ef-e4993cbb03f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:41.034586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e78cf-3555-451a-a1ef-e4993cbb03f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:41.035316 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e78cf-3555-451a-a1ef-e4993cbb03f2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:41.035613 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e78cf-3555-451a-a1ef-e4993cbb03f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:41.037211 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e78cf-3555-451a-a1ef-e4993cbb03f2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:41.045285 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 539/1093] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:41.051046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1befe2-5bca-44be-b91f-a00e764c4068 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:41.061671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1befe2-5bca-44be-b91f-a00e764c4068 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:41.066182 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadc043-4961-4df1-8511-bee6b2697506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:41.067005 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadc043-4961-4df1-8511-bee6b2697506 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:41.067284 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadc043-4961-4df1-8511-bee6b2697506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:41.067560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadc043-4961-4df1-8511-bee6b2697506 admin admin] PATH_INFO: `/v3/users/5f5c55ee0df7450289d6d57df99f1449` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:41.068741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadc043-4961-4df1-8511-bee6b2697506 admin admin] RBAC: Authorizing `identity:get_user(user_id=5f5c55ee0df7450289d6d57df99f1449)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:41.070835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadc043-4961-4df1-8511-bee6b2697506 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:41.072408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 555/1094] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:15:41 2022] GET /identity/v3/users/5f5c55ee0df7450289d6d57df99f1449 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:41.078456 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e78cf-3555-451a-a1ef-e4993cbb03f2 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:41.087618 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e78cf-3555-451a-a1ef-e4993cbb03f2 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:41.091964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f07e2-1cc5-43c9-b62c-0375101efdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:41.093115 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f07e2-1cc5-43c9-b62c-0375101efdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:41.093391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f07e2-1cc5-43c9-b62c-0375101efdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:41.093691 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f07e2-1cc5-43c9-b62c-0375101efdb1 admin admin] PATH_INFO: `/v3/projects/6ff27c883df246d6bc67ec4aeccc898d` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:41.094859 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f07e2-1cc5-43c9-b62c-0375101efdb1 admin admin] RBAC: Authorizing `identity:get_project(project_id=6ff27c883df246d6bc67ec4aeccc898d)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:41.096908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f07e2-1cc5-43c9-b62c-0375101efdb1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:41.098499 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 540/1095] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:15:41 2022] GET /identity/v3/projects/6ff27c883df246d6bc67ec4aeccc898d => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:15:41.103938 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadc043-4961-4df1-8511-bee6b2697506 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:41.113345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadc043-4961-4df1-8511-bee6b2697506 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:41.117804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e97f3f-e88e-4536-b82b-41d27e22e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:41.118637 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97f3f-e88e-4536-b82b-41d27e22e932 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:41.118919 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97f3f-e88e-4536-b82b-41d27e22e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:41.119192 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e97f3f-e88e-4536-b82b-41d27e22e932 admin admin] PATH_INFO: `/v3/projects/6ff27c883df246d6bc67ec4aeccc898d/users/5f5c55ee0df7450289d6d57df99f1449/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:41.121140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e97f3f-e88e-4536-b82b-41d27e22e932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff27c883df246d6bc67ec4aeccc898d, user_id=5f5c55ee0df7450289d6d57df99f1449, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:41.124376 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e97f3f-e88e-4536-b82b-41d27e22e932 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:41.136615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 556/1096] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:15:41 2022] PUT /identity/v3/projects/6ff27c883df246d6bc67ec4aeccc898d/users/5f5c55ee0df7450289d6d57df99f1449/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:15:43.394231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cecf4-6432-4b12-ae2b-48aa8090ba08 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:43.394782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cecf4-6432-4b12-ae2b-48aa8090ba08 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:43.394782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cecf4-6432-4b12-ae2b-48aa8090ba08 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:43.396550 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 541/1097] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:43.401591 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7ac35-670f-4bf4-815e-f6385d6598b0 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:43.401992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7ac35-670f-4bf4-815e-f6385d6598b0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:43.402140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7ac35-670f-4bf4-815e-f6385d6598b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:43.419248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0cb7ac35-670f-4bf4-815e-f6385d6598b0 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:43.420568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0cb7ac35-670f-4bf4-815e-f6385d6598b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:43.475619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 557/1098] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:15:43.499409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cecf4-6432-4b12-ae2b-48aa8090ba08 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:43.511423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cecf4-6432-4b12-ae2b-48aa8090ba08 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:43.516842 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be53425-2feb-435d-8aa9-829a8617290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:43.517600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be53425-2feb-435d-8aa9-829a8617290b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:43.517881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be53425-2feb-435d-8aa9-829a8617290b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:43.518154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be53425-2feb-435d-8aa9-829a8617290b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:43.528042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be53425-2feb-435d-8aa9-829a8617290b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:15:43.534897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-6be53425-2feb-435d-8aa9-829a8617290b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:15:43.536030 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 542/1099] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:15:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:15:43.541685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7ac35-670f-4bf4-815e-f6385d6598b0 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:43.551508 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7ac35-670f-4bf4-815e-f6385d6598b0 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:43.555950 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010d794-0eeb-4bfa-9600-f457fb43f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:43.556621 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d794-0eeb-4bfa-9600-f457fb43f90f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:43.556900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d794-0eeb-4bfa-9600-f457fb43f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:43.557173 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d794-0eeb-4bfa-9600-f457fb43f90f admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:43.557909 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010d794-0eeb-4bfa-9600-f457fb43f90f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:43.558211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010d794-0eeb-4bfa-9600-f457fb43f90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:43.559801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010d794-0eeb-4bfa-9600-f457fb43f90f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:43.568432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 558/1100] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:43.573794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be53425-2feb-435d-8aa9-829a8617290b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:43.584528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be53425-2feb-435d-8aa9-829a8617290b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:43.588985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343743b-da92-45a0-a602-4bab06f515f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:43.589800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343743b-da92-45a0-a602-4bab06f515f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:43.590082 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343743b-da92-45a0-a602-4bab06f515f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:43.590357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343743b-da92-45a0-a602-4bab06f515f3 admin admin] PATH_INFO: `/v3/users/5f5c55ee0df7450289d6d57df99f1449` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:43.591533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343743b-da92-45a0-a602-4bab06f515f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=5f5c55ee0df7450289d6d57df99f1449)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:43.593685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343743b-da92-45a0-a602-4bab06f515f3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:43.595257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 543/1101] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:15:43 2022] GET /identity/v3/users/5f5c55ee0df7450289d6d57df99f1449 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:43.600511 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010d794-0eeb-4bfa-9600-f457fb43f90f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:43.609766 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010d794-0eeb-4bfa-9600-f457fb43f90f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:43.614193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b0103-29f0-4ad5-aa52-fb97bd374705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:43.614798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b0103-29f0-4ad5-aa52-fb97bd374705 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:43.615076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b0103-29f0-4ad5-aa52-fb97bd374705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:43.615346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b0103-29f0-4ad5-aa52-fb97bd374705 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:43.622697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b0103-29f0-4ad5-aa52-fb97bd374705 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:43.624991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b0103-29f0-4ad5-aa52-fb97bd374705 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:43.633394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 559/1102] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:43 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:15:43.638701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343743b-da92-45a0-a602-4bab06f515f3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:43.649158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343743b-da92-45a0-a602-4bab06f515f3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:43.653754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8c6b7-3a76-413f-bf7e-a1d073000a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:43.654669 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8c6b7-3a76-413f-bf7e-a1d073000a53 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:43.655009 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8c6b7-3a76-413f-bf7e-a1d073000a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:43.655424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8c6b7-3a76-413f-bf7e-a1d073000a53 admin admin] PATH_INFO: `/v3/projects/6ff27c883df246d6bc67ec4aeccc898d` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:43.656628 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8c6b7-3a76-413f-bf7e-a1d073000a53 admin admin] RBAC: Authorizing `identity:get_project(project_id=6ff27c883df246d6bc67ec4aeccc898d)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:43.658633 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8c6b7-3a76-413f-bf7e-a1d073000a53 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:43.660286 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 544/1103] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:15:43 2022] GET /identity/v3/projects/6ff27c883df246d6bc67ec4aeccc898d => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:43.665889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b0103-29f0-4ad5-aa52-fb97bd374705 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:43.674810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b0103-29f0-4ad5-aa52-fb97bd374705 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:43.679282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b47aa-edd4-4978-871d-cd45a3fa2944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:43.679882 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b47aa-edd4-4978-871d-cd45a3fa2944 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:43.680196 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b47aa-edd4-4978-871d-cd45a3fa2944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:43.680468 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b47aa-edd4-4978-871d-cd45a3fa2944 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:43.681266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b47aa-edd4-4978-871d-cd45a3fa2944 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=6ff27c883df246d6bc67ec4aeccc898d, user.id=5f5c55ee0df7450289d6d57df99f1449) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:43.681570 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b47aa-edd4-4978-871d-cd45a3fa2944 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:43.683355 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b47aa-edd4-4978-871d-cd45a3fa2944 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:43.690557 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 560/1104] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:43 2022] GET /identity/v3/role_assignments?user.id=5f5c55ee0df7450289d6d57df99f1449&scope.project.id=6ff27c883df246d6bc67ec4aeccc898d&role.id=0e45946c6336419abb2015d8916e31ca => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:45.970928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235d381-4f16-4fa7-b400-a1e95c3367c3 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:45.971497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235d381-4f16-4fa7-b400-a1e95c3367c3 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:45.971497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235d381-4f16-4fa7-b400-a1e95c3367c3 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:45.973243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 545/1105] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:45.978456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8915e-b61c-477a-af7f-02e3303b03b3 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:45.978864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8915e-b61c-477a-af7f-02e3303b03b3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:45.979008 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8915e-b61c-477a-af7f-02e3303b03b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:45.997079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6cc8915e-b61c-477a-af7f-02e3303b03b3 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:45.998259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6cc8915e-b61c-477a-af7f-02e3303b03b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:46.006472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 561/1106] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:45 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:46.031527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235d381-4f16-4fa7-b400-a1e95c3367c3 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:46.043562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235d381-4f16-4fa7-b400-a1e95c3367c3 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:46.048486 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d025147-def5-4788-b6ae-d68ef2d6451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:46.049248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d025147-def5-4788-b6ae-d68ef2d6451b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:46.049528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d025147-def5-4788-b6ae-d68ef2d6451b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:46.049804 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d025147-def5-4788-b6ae-d68ef2d6451b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:46.050953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d025147-def5-4788-b6ae-d68ef2d6451b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:46.052688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d025147-def5-4788-b6ae-d68ef2d6451b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:46.054257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 546/1107] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:46.059752 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8915e-b61c-477a-af7f-02e3303b03b3 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:46.069096 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8915e-b61c-477a-af7f-02e3303b03b3 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:46.073571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e25a8-ca39-452c-bec4-200a43191854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:46.074206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e25a8-ca39-452c-bec4-200a43191854 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:46.074485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e25a8-ca39-452c-bec4-200a43191854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:46.074753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e25a8-ca39-452c-bec4-200a43191854 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:46.075442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e25a8-ca39-452c-bec4-200a43191854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:46.077538 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e25a8-ca39-452c-bec4-200a43191854 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:46.096747 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 562/1108] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:15:46 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:15:48.466581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc603f4-e708-4ca3-b732-a0fe22fd958e None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:48.467130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc603f4-e708-4ca3-b732-a0fe22fd958e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:48.467130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc603f4-e708-4ca3-b732-a0fe22fd958e None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:48.469126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 547/1109] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:48.474250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac43a1-4fd6-42cc-a96a-ba653db4daf1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:48.474662 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac43a1-4fd6-42cc-a96a-ba653db4daf1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:48.474810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac43a1-4fd6-42cc-a96a-ba653db4daf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:48.493117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c9ac43a1-4fd6-42cc-a96a-ba653db4daf1 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:48.494293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c9ac43a1-4fd6-42cc-a96a-ba653db4daf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:48.503083 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 563/1110] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:48.526675 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc603f4-e708-4ca3-b732-a0fe22fd958e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:48.538600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc603f4-e708-4ca3-b732-a0fe22fd958e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:48.542837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6fa0f-ace0-4013-a84d-18c7a57c30d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:48.543643 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6fa0f-ace0-4013-a84d-18c7a57c30d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:48.543919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6fa0f-ace0-4013-a84d-18c7a57c30d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:48.544214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6fa0f-ace0-4013-a84d-18c7a57c30d6 admin admin] PATH_INFO: `/v3/roles/34d194b1309f45d9a8ad70d08ccb4230` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:48.546183 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6fa0f-ace0-4013-a84d-18c7a57c30d6 admin admin] RBAC: Authorizing `identity:get_role(role_id=34d194b1309f45d9a8ad70d08ccb4230)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:48.547170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-5ee6fa0f-ace0-4013-a84d-18c7a57c30d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:15:48.547170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:15:48.547170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:15:48.548038 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6fa0f-ace0-4013-a84d-18c7a57c30d6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:48.549336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 548/1111] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:15:48 2022] GET /identity/v3/roles/34d194b1309f45d9a8ad70d08ccb4230 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:48.554677 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac43a1-4fd6-42cc-a96a-ba653db4daf1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:48.564433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac43a1-4fd6-42cc-a96a-ba653db4daf1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:48.568951 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9d075-7419-48d9-b6f3-482c7c4e6f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:48.569782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9d075-7419-48d9-b6f3-482c7c4e6f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:48.570061 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9d075-7419-48d9-b6f3-482c7c4e6f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:48.570329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9d075-7419-48d9-b6f3-482c7c4e6f79 admin admin] PATH_INFO: `/v3/users/47b0e57d34be4b55a73d6071c0870809` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:48.583571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9d075-7419-48d9-b6f3-482c7c4e6f79 admin admin] RBAC: Authorizing `identity:get_user(user_id=47b0e57d34be4b55a73d6071c0870809)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:48.585709 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9d075-7419-48d9-b6f3-482c7c4e6f79 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:48.587279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 564/1112] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:15:48 2022] GET /identity/v3/users/47b0e57d34be4b55a73d6071c0870809 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:48.593376 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6fa0f-ace0-4013-a84d-18c7a57c30d6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:48.602546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6fa0f-ace0-4013-a84d-18c7a57c30d6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:48.606992 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2d1d5-22c2-4f00-86c8-c5ea9befdab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:48.607614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2d1d5-22c2-4f00-86c8-c5ea9befdab8 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:48.608646 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2d1d5-22c2-4f00-86c8-c5ea9befdab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:48.608935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2d1d5-22c2-4f00-86c8-c5ea9befdab8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:48.616542 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2d1d5-22c2-4f00-86c8-c5ea9befdab8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:48.618259 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2d1d5-22c2-4f00-86c8-c5ea9befdab8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:48.626829 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 549/1113] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:48 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:15:48.632260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9d075-7419-48d9-b6f3-482c7c4e6f79 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:48.642053 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9d075-7419-48d9-b6f3-482c7c4e6f79 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:48.646526 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbc914-a2a4-4e53-bcd1-7ae36f0d7932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:48.647345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbc914-a2a4-4e53-bcd1-7ae36f0d7932 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:48.647624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbc914-a2a4-4e53-bcd1-7ae36f0d7932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:48.647895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbc914-a2a4-4e53-bcd1-7ae36f0d7932 admin admin] PATH_INFO: `/v3/projects/6ff27c883df246d6bc67ec4aeccc898d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:48.649083 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbc914-a2a4-4e53-bcd1-7ae36f0d7932 admin admin] RBAC: Authorizing `identity:get_project(project_id=6ff27c883df246d6bc67ec4aeccc898d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:48.651102 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dbc914-a2a4-4e53-bcd1-7ae36f0d7932 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:48.652858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 565/1114] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:15:48 2022] GET /identity/v3/projects/6ff27c883df246d6bc67ec4aeccc898d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:48.658706 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2d1d5-22c2-4f00-86c8-c5ea9befdab8 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:48.667101 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2d1d5-22c2-4f00-86c8-c5ea9befdab8 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:48.672275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af308cd5-37b4-43ff-921e-6109adb9fbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:48.672884 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af308cd5-37b4-43ff-921e-6109adb9fbbb admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:48.673505 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af308cd5-37b4-43ff-921e-6109adb9fbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:48.673780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af308cd5-37b4-43ff-921e-6109adb9fbbb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:48.674578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af308cd5-37b4-43ff-921e-6109adb9fbbb admin admin] RBAC: Adding query filter params (role.id=34d194b1309f45d9a8ad70d08ccb4230, scope.project.id=6ff27c883df246d6bc67ec4aeccc898d, user.id=47b0e57d34be4b55a73d6071c0870809) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:48.674880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af308cd5-37b4-43ff-921e-6109adb9fbbb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:48.676697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af308cd5-37b4-43ff-921e-6109adb9fbbb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:48.681813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 550/1115] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:48 2022] GET /identity/v3/role_assignments?user.id=47b0e57d34be4b55a73d6071c0870809&scope.project.id=6ff27c883df246d6bc67ec4aeccc898d&role.id=34d194b1309f45d9a8ad70d08ccb4230 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:50.948043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097fd3d-50cd-423c-b955-b50f873b113d None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:50.948642 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097fd3d-50cd-423c-b955-b50f873b113d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:50.948642 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097fd3d-50cd-423c-b955-b50f873b113d None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:50.950402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 566/1116] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:50.956348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323f77b-5c33-4f1d-85f8-bee18fbdcc15 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:50.956816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323f77b-5c33-4f1d-85f8-bee18fbdcc15 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:50.956913 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323f77b-5c33-4f1d-85f8-bee18fbdcc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:50.974340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-e323f77b-5c33-4f1d-85f8-bee18fbdcc15 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:50.975512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e323f77b-5c33-4f1d-85f8-bee18fbdcc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:50.983293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 551/1117] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:51.006405 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097fd3d-50cd-423c-b955-b50f873b113d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:51.019462 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097fd3d-50cd-423c-b955-b50f873b113d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:51.023762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e5705-1924-4460-8c20-7beee4f469c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:51.024616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e5705-1924-4460-8c20-7beee4f469c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:51.024896 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e5705-1924-4460-8c20-7beee4f469c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:51.025171 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e5705-1924-4460-8c20-7beee4f469c4 admin admin] PATH_INFO: `/v3/roles/34d194b1309f45d9a8ad70d08ccb4230` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:51.026620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e5705-1924-4460-8c20-7beee4f469c4 admin admin] RBAC: Authorizing `identity:get_role(role_id=34d194b1309f45d9a8ad70d08ccb4230)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:51.027627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-e00e5705-1924-4460-8c20-7beee4f469c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:15:51.027627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:15:51.027627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:15:51.028529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e5705-1924-4460-8c20-7beee4f469c4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:51.029889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 567/1118] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:15:51 2022] GET /identity/v3/roles/34d194b1309f45d9a8ad70d08ccb4230 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:51.035700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323f77b-5c33-4f1d-85f8-bee18fbdcc15 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:51.044514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323f77b-5c33-4f1d-85f8-bee18fbdcc15 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:51.049097 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200ba97-3ffc-4fd5-b6c7-43f96fdd71aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:51.049942 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200ba97-3ffc-4fd5-b6c7-43f96fdd71aa admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:51.050224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200ba97-3ffc-4fd5-b6c7-43f96fdd71aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:51.050496 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200ba97-3ffc-4fd5-b6c7-43f96fdd71aa admin admin] PATH_INFO: `/v3/users/47b0e57d34be4b55a73d6071c0870809` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:51.051668 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200ba97-3ffc-4fd5-b6c7-43f96fdd71aa admin admin] RBAC: Authorizing `identity:get_user(user_id=47b0e57d34be4b55a73d6071c0870809)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:51.053796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200ba97-3ffc-4fd5-b6c7-43f96fdd71aa admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:51.055349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 552/1119] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:15:51 2022] GET /identity/v3/users/47b0e57d34be4b55a73d6071c0870809 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:51.060653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e5705-1924-4460-8c20-7beee4f469c4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:51.070485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e5705-1924-4460-8c20-7beee4f469c4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:51.074890 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17655082-2f61-46ab-8fc3-c15d175995dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:51.075698 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17655082-2f61-46ab-8fc3-c15d175995dc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:51.075978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17655082-2f61-46ab-8fc3-c15d175995dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:51.076284 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17655082-2f61-46ab-8fc3-c15d175995dc admin admin] PATH_INFO: `/v3/projects/6ff27c883df246d6bc67ec4aeccc898d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:51.078063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17655082-2f61-46ab-8fc3-c15d175995dc admin admin] RBAC: Authorizing `identity:get_project(project_id=6ff27c883df246d6bc67ec4aeccc898d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:51.080107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17655082-2f61-46ab-8fc3-c15d175995dc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:51.081826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 568/1120] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:15:51 2022] GET /identity/v3/projects/6ff27c883df246d6bc67ec4aeccc898d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:51.086999 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200ba97-3ffc-4fd5-b6c7-43f96fdd71aa admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:51.096810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200ba97-3ffc-4fd5-b6c7-43f96fdd71aa admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:51.101249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a54ed9-21c4-4912-9935-445c280a7a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:51.102080 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a54ed9-21c4-4912-9935-445c280a7a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:51.102360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a54ed9-21c4-4912-9935-445c280a7a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:51.102633 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a54ed9-21c4-4912-9935-445c280a7a14 admin admin] PATH_INFO: `/v3/projects/6ff27c883df246d6bc67ec4aeccc898d/users/47b0e57d34be4b55a73d6071c0870809/roles/34d194b1309f45d9a8ad70d08ccb4230` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:51.104811 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a54ed9-21c4-4912-9935-445c280a7a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff27c883df246d6bc67ec4aeccc898d, user_id=47b0e57d34be4b55a73d6071c0870809, role_id=34d194b1309f45d9a8ad70d08ccb4230)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:51.107381 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a54ed9-21c4-4912-9935-445c280a7a14 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:51.120490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 553/1121] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:15:51 2022] PUT /identity/v3/projects/6ff27c883df246d6bc67ec4aeccc898d/users/47b0e57d34be4b55a73d6071c0870809/roles/34d194b1309f45d9a8ad70d08ccb4230 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:15:53.470210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c3ca-00e6-4470-b4a0-88b04fc195b6 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:53.470782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c3ca-00e6-4470-b4a0-88b04fc195b6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:53.470782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659c3ca-00e6-4470-b4a0-88b04fc195b6 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:53.472567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 569/1122] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:53.477761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e501de-e471-4e7b-8398-cf42e3233253 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:53.478184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e501de-e471-4e7b-8398-cf42e3233253 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:53.478313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e501de-e471-4e7b-8398-cf42e3233253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:53.501440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-14e501de-e471-4e7b-8398-cf42e3233253 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:53.503113 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-14e501de-e471-4e7b-8398-cf42e3233253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:53.566765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 554/1123] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:53.590654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659c3ca-00e6-4470-b4a0-88b04fc195b6 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:53.602638 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659c3ca-00e6-4470-b4a0-88b04fc195b6 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:53.606906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7f4f8-a4ac-4448-a067-db338900ea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:53.608452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7f4f8-a4ac-4448-a067-db338900ea5f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:53.608735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7f4f8-a4ac-4448-a067-db338900ea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:53.609006 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7f4f8-a4ac-4448-a067-db338900ea5f admin admin] PATH_INFO: `/v3/roles/34d194b1309f45d9a8ad70d08ccb4230` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:53.610452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7f4f8-a4ac-4448-a067-db338900ea5f admin admin] RBAC: Authorizing `identity:get_role(role_id=34d194b1309f45d9a8ad70d08ccb4230)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:53.612041 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7f4f8-a4ac-4448-a067-db338900ea5f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:53.613338 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 570/1124] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:15:53 2022] GET /identity/v3/roles/34d194b1309f45d9a8ad70d08ccb4230 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:53.618729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e501de-e471-4e7b-8398-cf42e3233253 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:53.627958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e501de-e471-4e7b-8398-cf42e3233253 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:53.633088 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874e7a7-6607-4819-a9d3-b69a82aece3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:53.633928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e7a7-6607-4819-a9d3-b69a82aece3b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:53.634203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e7a7-6607-4819-a9d3-b69a82aece3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:53.634470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e7a7-6607-4819-a9d3-b69a82aece3b admin admin] PATH_INFO: `/v3/users/47b0e57d34be4b55a73d6071c0870809` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:53.635636 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874e7a7-6607-4819-a9d3-b69a82aece3b admin admin] RBAC: Authorizing `identity:get_user(user_id=47b0e57d34be4b55a73d6071c0870809)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:53.637752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874e7a7-6607-4819-a9d3-b69a82aece3b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:53.639315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 555/1125] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:15:53 2022] GET /identity/v3/users/47b0e57d34be4b55a73d6071c0870809 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:53.644894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7f4f8-a4ac-4448-a067-db338900ea5f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:53.653994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7f4f8-a4ac-4448-a067-db338900ea5f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:53.658604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554334c-5379-4d94-a28b-d1a27299be50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:53.659200 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554334c-5379-4d94-a28b-d1a27299be50 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:53.659482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554334c-5379-4d94-a28b-d1a27299be50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:53.659776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554334c-5379-4d94-a28b-d1a27299be50 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:53.667165 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554334c-5379-4d94-a28b-d1a27299be50 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:53.668932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554334c-5379-4d94-a28b-d1a27299be50 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:53.678175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 571/1126] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:15:53 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:15:53.683625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874e7a7-6607-4819-a9d3-b69a82aece3b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:53.693736 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874e7a7-6607-4819-a9d3-b69a82aece3b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:53.698312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c75bf-ec1c-4799-a85d-e113f689c55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:53.699127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c75bf-ec1c-4799-a85d-e113f689c55f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:53.699410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c75bf-ec1c-4799-a85d-e113f689c55f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:53.699689 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c75bf-ec1c-4799-a85d-e113f689c55f admin admin] PATH_INFO: `/v3/projects/6ff27c883df246d6bc67ec4aeccc898d` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:53.700867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c75bf-ec1c-4799-a85d-e113f689c55f admin admin] RBAC: Authorizing `identity:get_project(project_id=6ff27c883df246d6bc67ec4aeccc898d)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:53.702915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c75bf-ec1c-4799-a85d-e113f689c55f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:53.704606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 556/1127] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:15:53 2022] GET /identity/v3/projects/6ff27c883df246d6bc67ec4aeccc898d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:53.710331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554334c-5379-4d94-a28b-d1a27299be50 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:53.718811 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554334c-5379-4d94-a28b-d1a27299be50 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:53.723307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d3aa7-ba30-4e05-9eab-1ade83620505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:53.723849 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d3aa7-ba30-4e05-9eab-1ade83620505 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:53.724161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d3aa7-ba30-4e05-9eab-1ade83620505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:53.724430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d3aa7-ba30-4e05-9eab-1ade83620505 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:53.725231 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d3aa7-ba30-4e05-9eab-1ade83620505 admin admin] RBAC: Adding query filter params (role.id=34d194b1309f45d9a8ad70d08ccb4230, scope.project.id=6ff27c883df246d6bc67ec4aeccc898d, user.id=47b0e57d34be4b55a73d6071c0870809) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:15:53.725533 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d3aa7-ba30-4e05-9eab-1ade83620505 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:53.727311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d3aa7-ba30-4e05-9eab-1ade83620505 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:53.733455 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 572/1128] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:15:53 2022] GET /identity/v3/role_assignments?user.id=47b0e57d34be4b55a73d6071c0870809&scope.project.id=6ff27c883df246d6bc67ec4aeccc898d&role.id=34d194b1309f45d9a8ad70d08ccb4230 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:56.097556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940b4e4-3926-407e-9f19-cbbbb7765ae6 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:56.098070 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940b4e4-3926-407e-9f19-cbbbb7765ae6 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:56.098182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940b4e4-3926-407e-9f19-cbbbb7765ae6 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:56.099864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 557/1129] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:56.105048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50abc6f-9062-40ec-9bac-82062b1fe649 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:56.105438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50abc6f-9062-40ec-9bac-82062b1fe649 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:56.105601 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50abc6f-9062-40ec-9bac-82062b1fe649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:56.123072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d50abc6f-9062-40ec-9bac-82062b1fe649 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:56.125111 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d50abc6f-9062-40ec-9bac-82062b1fe649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:56.132754 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 573/1130] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:56.157195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940b4e4-3926-407e-9f19-cbbbb7765ae6 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:56.168995 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940b4e4-3926-407e-9f19-cbbbb7765ae6 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:56.173437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd34c9-3802-4861-8faf-9ef5e353bcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:56.174193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd34c9-3802-4861-8faf-9ef5e353bcae admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:56.174469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd34c9-3802-4861-8faf-9ef5e353bcae admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:56.174739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd34c9-3802-4861-8faf-9ef5e353bcae admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:56.175897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd34c9-3802-4861-8faf-9ef5e353bcae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:56.177583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd34c9-3802-4861-8faf-9ef5e353bcae admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:56.179109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 558/1131] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:56.184728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50abc6f-9062-40ec-9bac-82062b1fe649 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:56.194162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50abc6f-9062-40ec-9bac-82062b1fe649 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:56.198661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65062f12-f0d3-4be5-a731-54a433b8b28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:56.199297 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65062f12-f0d3-4be5-a731-54a433b8b28f admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:56.199582 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65062f12-f0d3-4be5-a731-54a433b8b28f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:56.199857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65062f12-f0d3-4be5-a731-54a433b8b28f admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:56.200600 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65062f12-f0d3-4be5-a731-54a433b8b28f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:56.203252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65062f12-f0d3-4be5-a731-54a433b8b28f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:56.228480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 574/1132] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:15:56 2022] POST /identity/v3/projects => generated 311 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:15:58.577159 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5bec7-8ed4-4e85-a352-d868c4fa2336 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:58.577709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5bec7-8ed4-4e85-a352-d868c4fa2336 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:58.577709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5bec7-8ed4-4e85-a352-d868c4fa2336 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:58.579437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 559/1133] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:15:58.584568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80a0a1-a913-4846-9c5b-ae95a34f85f8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:58.584950 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80a0a1-a913-4846-9c5b-ae95a34f85f8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:58.585126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80a0a1-a913-4846-9c5b-ae95a34f85f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:58.602530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ae80a0a1-a913-4846-9c5b-ae95a34f85f8 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:15:58.603698 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ae80a0a1-a913-4846-9c5b-ae95a34f85f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:15:58.661411 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 575/1134] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:15:58 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:15:58.685670 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5bec7-8ed4-4e85-a352-d868c4fa2336 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:58.698131 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5bec7-8ed4-4e85-a352-d868c4fa2336 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:58.703127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6637d7-1a69-496c-bf5d-8e238452e02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:58.703880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6637d7-1a69-496c-bf5d-8e238452e02d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:58.704185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6637d7-1a69-496c-bf5d-8e238452e02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:58.704459 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6637d7-1a69-496c-bf5d-8e238452e02d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:58.705586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6637d7-1a69-496c-bf5d-8e238452e02d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:58.707236 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6637d7-1a69-496c-bf5d-8e238452e02d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:58.708791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 560/1135] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:15:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:15:58.714234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80a0a1-a913-4846-9c5b-ae95a34f85f8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:15:58.722986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80a0a1-a913-4846-9c5b-ae95a34f85f8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:15:58.727407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64410ffb-02d2-4979-9aab-7559b6503507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:15:58.728084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64410ffb-02d2-4979-9aab-7559b6503507 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:15:58.728365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64410ffb-02d2-4979-9aab-7559b6503507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:15:58.728633 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64410ffb-02d2-4979-9aab-7559b6503507 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:15:58.729321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64410ffb-02d2-4979-9aab-7559b6503507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:15:58.731187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64410ffb-02d2-4979-9aab-7559b6503507 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:15:58.752990 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 576/1136] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:15:58 2022] POST /identity/v3/users => generated 286 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:16:01.140889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c6b69-031d-48f4-bfb5-07a6f67eece7 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:01.141419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c6b69-031d-48f4-bfb5-07a6f67eece7 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:01.141419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c6b69-031d-48f4-bfb5-07a6f67eece7 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:01.143430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 561/1137] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:16:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:16:01.148581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8815ece-d027-4dd0-b93a-8a7083dcb2f2 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:01.149002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8815ece-d027-4dd0-b93a-8a7083dcb2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:01.149129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8815ece-d027-4dd0-b93a-8a7083dcb2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:01.167017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f8815ece-d027-4dd0-b93a-8a7083dcb2f2 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:16:01.168206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f8815ece-d027-4dd0-b93a-8a7083dcb2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:16:01.175782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 577/1138] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:16:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:16:01.199580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c6b69-031d-48f4-bfb5-07a6f67eece7 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:01.212469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c6b69-031d-48f4-bfb5-07a6f67eece7 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:01.216792 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca461c-5c79-4061-8ced-eb13b0f644b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:01.218626 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca461c-5c79-4061-8ced-eb13b0f644b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:01.218906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca461c-5c79-4061-8ced-eb13b0f644b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:01.219177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca461c-5c79-4061-8ced-eb13b0f644b0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:01.228998 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca461c-5c79-4061-8ced-eb13b0f644b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:16:01.236202 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-13ca461c-5c79-4061-8ced-eb13b0f644b0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:16:01.237328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 562/1139] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:16:01.242873 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8815ece-d027-4dd0-b93a-8a7083dcb2f2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:01.251674 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8815ece-d027-4dd0-b93a-8a7083dcb2f2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:01.256077 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eb586-eb3c-456e-9a50-a8d2ad083de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:01.256714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eb586-eb3c-456e-9a50-a8d2ad083de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:01.256991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eb586-eb3c-456e-9a50-a8d2ad083de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:01.257259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eb586-eb3c-456e-9a50-a8d2ad083de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:01.257989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317eb586-eb3c-456e-9a50-a8d2ad083de3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:16:01.258289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317eb586-eb3c-456e-9a50-a8d2ad083de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:01.259855 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317eb586-eb3c-456e-9a50-a8d2ad083de3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:01.268885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 578/1140] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:16:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:01.274165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca461c-5c79-4061-8ced-eb13b0f644b0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:01.284724 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca461c-5c79-4061-8ced-eb13b0f644b0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:01.289135 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ba926-1eb3-4ba0-ada9-9e77d4f25bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:01.289946 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ba926-1eb3-4ba0-ada9-9e77d4f25bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:01.290221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ba926-1eb3-4ba0-ada9-9e77d4f25bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:01.290492 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ba926-1eb3-4ba0-ada9-9e77d4f25bd7 admin admin] PATH_INFO: `/v3/users/aeb23c010755413aa206c8dff125dae6` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:01.303160 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ba926-1eb3-4ba0-ada9-9e77d4f25bd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=aeb23c010755413aa206c8dff125dae6)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:01.305280 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ba926-1eb3-4ba0-ada9-9e77d4f25bd7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:01.306839 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 563/1141] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:16:01 2022] GET /identity/v3/users/aeb23c010755413aa206c8dff125dae6 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:01.313084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eb586-eb3c-456e-9a50-a8d2ad083de3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:01.322371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eb586-eb3c-456e-9a50-a8d2ad083de3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:01.327516 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fe5b5-98dc-4a68-81e2-35a736aba7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:01.328187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fe5b5-98dc-4a68-81e2-35a736aba7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:01.328468 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fe5b5-98dc-4a68-81e2-35a736aba7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:01.328737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fe5b5-98dc-4a68-81e2-35a736aba7ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:01.336126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fe5b5-98dc-4a68-81e2-35a736aba7ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:01.337833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88fe5b5-98dc-4a68-81e2-35a736aba7ac admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:01.346887 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 579/1142] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:16:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:16:01.352556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ba926-1eb3-4ba0-ada9-9e77d4f25bd7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:01.362228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ba926-1eb3-4ba0-ada9-9e77d4f25bd7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:01.366743 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87d6e5-bf91-4e9d-a23d-603aa44f663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:01.367568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87d6e5-bf91-4e9d-a23d-603aa44f663f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:01.367849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87d6e5-bf91-4e9d-a23d-603aa44f663f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:01.368166 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87d6e5-bf91-4e9d-a23d-603aa44f663f admin admin] PATH_INFO: `/v3/projects/65aba574c5cb4982a3ea8d305df35bb6` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:01.369324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87d6e5-bf91-4e9d-a23d-603aa44f663f admin admin] RBAC: Authorizing `identity:get_project(project_id=65aba574c5cb4982a3ea8d305df35bb6)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:01.371330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87d6e5-bf91-4e9d-a23d-603aa44f663f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:01.372978 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 564/1143] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:16:01 2022] GET /identity/v3/projects/65aba574c5cb4982a3ea8d305df35bb6 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:01.379239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fe5b5-98dc-4a68-81e2-35a736aba7ac admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:01.387578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fe5b5-98dc-4a68-81e2-35a736aba7ac admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:01.393171 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635367c8-aa3c-49a0-abeb-5571aba4ea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:01.393776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635367c8-aa3c-49a0-abeb-5571aba4ea77 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:01.394054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635367c8-aa3c-49a0-abeb-5571aba4ea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:01.394323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635367c8-aa3c-49a0-abeb-5571aba4ea77 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:01.395116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635367c8-aa3c-49a0-abeb-5571aba4ea77 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=65aba574c5cb4982a3ea8d305df35bb6, user.id=aeb23c010755413aa206c8dff125dae6) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:16:01.395418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635367c8-aa3c-49a0-abeb-5571aba4ea77 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:01.397241 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635367c8-aa3c-49a0-abeb-5571aba4ea77 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:01.402305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 580/1144] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:16:01 2022] GET /identity/v3/role_assignments?user.id=aeb23c010755413aa206c8dff125dae6&scope.project.id=65aba574c5cb4982a3ea8d305df35bb6&role.id=0e45946c6336419abb2015d8916e31ca => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:03.678688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ecc90-c862-4a7f-b95a-bc5e7d357942 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:03.679255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ecc90-c862-4a7f-b95a-bc5e7d357942 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:03.679255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ecc90-c862-4a7f-b95a-bc5e7d357942 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:03.681035 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 565/1145] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:16:03.686637 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e248df-9c1a-4602-98d0-c0da72c5323c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:03.687081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e248df-9c1a-4602-98d0-c0da72c5323c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:03.687174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e248df-9c1a-4602-98d0-c0da72c5323c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:03.705175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c8e248df-9c1a-4602-98d0-c0da72c5323c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:16:03.706355 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c8e248df-9c1a-4602-98d0-c0da72c5323c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:16:03.713865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 581/1146] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:16:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:16:03.737954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ecc90-c862-4a7f-b95a-bc5e7d357942 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:03.750485 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ecc90-c862-4a7f-b95a-bc5e7d357942 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:03.754765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec15da-e2ed-4bc6-b4ae-fdbbe22cf492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:03.755518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec15da-e2ed-4bc6-b4ae-fdbbe22cf492 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:03.755797 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec15da-e2ed-4bc6-b4ae-fdbbe22cf492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:03.756100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec15da-e2ed-4bc6-b4ae-fdbbe22cf492 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:03.766961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec15da-e2ed-4bc6-b4ae-fdbbe22cf492 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:16:03.773758 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-0eec15da-e2ed-4bc6-b4ae-fdbbe22cf492 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:16:03.774883 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 566/1147] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:16:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:16:03.780746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e248df-9c1a-4602-98d0-c0da72c5323c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:03.789490 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e248df-9c1a-4602-98d0-c0da72c5323c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:03.793983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ebad3-26f1-43e2-b07d-c8c19b436f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:03.794654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ebad3-26f1-43e2-b07d-c8c19b436f7e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:03.794939 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ebad3-26f1-43e2-b07d-c8c19b436f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:03.795496 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ebad3-26f1-43e2-b07d-c8c19b436f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:03.796053 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ebad3-26f1-43e2-b07d-c8c19b436f7e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:16:03.796379 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ebad3-26f1-43e2-b07d-c8c19b436f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:03.797953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ebad3-26f1-43e2-b07d-c8c19b436f7e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:03.805936 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 582/1148] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:16:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:03.811814 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec15da-e2ed-4bc6-b4ae-fdbbe22cf492 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:03.821702 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec15da-e2ed-4bc6-b4ae-fdbbe22cf492 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:03.826139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea522f5-3352-4c31-926e-1c39382b0df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:03.827600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea522f5-3352-4c31-926e-1c39382b0df3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:03.827874 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea522f5-3352-4c31-926e-1c39382b0df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:03.828182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea522f5-3352-4c31-926e-1c39382b0df3 admin admin] PATH_INFO: `/v3/users/aeb23c010755413aa206c8dff125dae6` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:03.829350 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea522f5-3352-4c31-926e-1c39382b0df3 admin admin] RBAC: Authorizing `identity:get_user(user_id=aeb23c010755413aa206c8dff125dae6)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:03.831428 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea522f5-3352-4c31-926e-1c39382b0df3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:03.833005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 567/1149] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:16:03 2022] GET /identity/v3/users/aeb23c010755413aa206c8dff125dae6 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:03.838188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ebad3-26f1-43e2-b07d-c8c19b436f7e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:03.847986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ebad3-26f1-43e2-b07d-c8c19b436f7e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:03.852443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f4823-805c-44c5-88b7-729054db79a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:03.853257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f4823-805c-44c5-88b7-729054db79a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:03.853541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f4823-805c-44c5-88b7-729054db79a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:03.853817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f4823-805c-44c5-88b7-729054db79a6 admin admin] PATH_INFO: `/v3/projects/65aba574c5cb4982a3ea8d305df35bb6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:03.854962 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f4823-805c-44c5-88b7-729054db79a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=65aba574c5cb4982a3ea8d305df35bb6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:03.857004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f4823-805c-44c5-88b7-729054db79a6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:03.859115 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 583/1150] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:16:03 2022] GET /identity/v3/projects/65aba574c5cb4982a3ea8d305df35bb6 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:03.864374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea522f5-3352-4c31-926e-1c39382b0df3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:03.873959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea522f5-3352-4c31-926e-1c39382b0df3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:03.878383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab436564-73f8-49c1-902e-b29326f9517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:03.879205 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab436564-73f8-49c1-902e-b29326f9517e admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:03.879477 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab436564-73f8-49c1-902e-b29326f9517e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:03.879769 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab436564-73f8-49c1-902e-b29326f9517e admin admin] PATH_INFO: `/v3/projects/65aba574c5cb4982a3ea8d305df35bb6/users/aeb23c010755413aa206c8dff125dae6/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:03.881695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab436564-73f8-49c1-902e-b29326f9517e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65aba574c5cb4982a3ea8d305df35bb6, user_id=aeb23c010755413aa206c8dff125dae6, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:03.884883 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab436564-73f8-49c1-902e-b29326f9517e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:03.900212 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 568/1151] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:16:03 2022] PUT /identity/v3/projects/65aba574c5cb4982a3ea8d305df35bb6/users/aeb23c010755413aa206c8dff125dae6/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:16:06.193025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5403a37-43c6-44ed-bd34-45e9b3a4c331 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:06.193558 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5403a37-43c6-44ed-bd34-45e9b3a4c331 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:06.193558 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5403a37-43c6-44ed-bd34-45e9b3a4c331 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:06.195378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 584/1152] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:16:06.200617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aef2cb-5271-4b7d-b7de-c094a3448d97 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:06.201047 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aef2cb-5271-4b7d-b7de-c094a3448d97 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:06.201197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aef2cb-5271-4b7d-b7de-c094a3448d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:06.222132 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-71aef2cb-5271-4b7d-b7de-c094a3448d97 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:16:06.223315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-71aef2cb-5271-4b7d-b7de-c094a3448d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:16:06.277087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 569/1153] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:16:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:16:06.301547 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5403a37-43c6-44ed-bd34-45e9b3a4c331 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:06.313534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5403a37-43c6-44ed-bd34-45e9b3a4c331 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:06.317783 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210576c5-ff03-4dd3-983a-26ef98acf3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:06.318535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210576c5-ff03-4dd3-983a-26ef98acf3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:06.318812 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210576c5-ff03-4dd3-983a-26ef98acf3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:06.319084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210576c5-ff03-4dd3-983a-26ef98acf3b4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:06.329466 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210576c5-ff03-4dd3-983a-26ef98acf3b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:16:06.336160 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-210576c5-ff03-4dd3-983a-26ef98acf3b4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:16:06.337280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 585/1154] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:16:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:16:06.343547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aef2cb-5271-4b7d-b7de-c094a3448d97 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:06.352152 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aef2cb-5271-4b7d-b7de-c094a3448d97 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:06.356562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21208953-0a5d-4fa0-b426-71940ef82caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:06.357194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21208953-0a5d-4fa0-b426-71940ef82caa admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:06.357467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21208953-0a5d-4fa0-b426-71940ef82caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:06.357793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21208953-0a5d-4fa0-b426-71940ef82caa admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:06.358543 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21208953-0a5d-4fa0-b426-71940ef82caa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:16:06.358841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21208953-0a5d-4fa0-b426-71940ef82caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:06.360427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21208953-0a5d-4fa0-b426-71940ef82caa admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:06.368327 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 570/1155] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:16:06.373699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210576c5-ff03-4dd3-983a-26ef98acf3b4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:06.383489 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210576c5-ff03-4dd3-983a-26ef98acf3b4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:06.387862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd12d1-8fdc-4747-b08f-d8dd553f2bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:06.388718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd12d1-8fdc-4747-b08f-d8dd553f2bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:06.389505 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd12d1-8fdc-4747-b08f-d8dd553f2bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:06.389768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd12d1-8fdc-4747-b08f-d8dd553f2bfa admin admin] PATH_INFO: `/v3/users/aeb23c010755413aa206c8dff125dae6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:06.391121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd12d1-8fdc-4747-b08f-d8dd553f2bfa admin admin] RBAC: Authorizing `identity:get_user(user_id=aeb23c010755413aa206c8dff125dae6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:06.393512 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd12d1-8fdc-4747-b08f-d8dd553f2bfa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:06.395038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 586/1156] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:16:06 2022] GET /identity/v3/users/aeb23c010755413aa206c8dff125dae6 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:06.400235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21208953-0a5d-4fa0-b426-71940ef82caa admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:06.410073 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21208953-0a5d-4fa0-b426-71940ef82caa admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:06.414473 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9848155-ef0b-4bbd-99c3-634bb12f41fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:06.415072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9848155-ef0b-4bbd-99c3-634bb12f41fa admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:06.415350 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9848155-ef0b-4bbd-99c3-634bb12f41fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:06.415619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9848155-ef0b-4bbd-99c3-634bb12f41fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:06.423770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9848155-ef0b-4bbd-99c3-634bb12f41fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:06.425502 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9848155-ef0b-4bbd-99c3-634bb12f41fa admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:06.433932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 571/1157] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:16:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:16:06.439843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd12d1-8fdc-4747-b08f-d8dd553f2bfa admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:06.449147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd12d1-8fdc-4747-b08f-d8dd553f2bfa admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:06.453806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13d0c3-f7f2-43c8-a965-837f3a39f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:06.454611 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13d0c3-f7f2-43c8-a965-837f3a39f78a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:06.454895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13d0c3-f7f2-43c8-a965-837f3a39f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:06.455173 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13d0c3-f7f2-43c8-a965-837f3a39f78a admin admin] PATH_INFO: `/v3/projects/65aba574c5cb4982a3ea8d305df35bb6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:06.456365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13d0c3-f7f2-43c8-a965-837f3a39f78a admin admin] RBAC: Authorizing `identity:get_project(project_id=65aba574c5cb4982a3ea8d305df35bb6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:06.458379 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13d0c3-f7f2-43c8-a965-837f3a39f78a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:06.460072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 587/1158] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:16:06 2022] GET /identity/v3/projects/65aba574c5cb4982a3ea8d305df35bb6 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:06.465392 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9848155-ef0b-4bbd-99c3-634bb12f41fa admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:06.474222 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9848155-ef0b-4bbd-99c3-634bb12f41fa admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:06.478712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971bb43-fee0-4f53-8940-20f92aaee320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:06.479328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971bb43-fee0-4f53-8940-20f92aaee320 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:06.479611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971bb43-fee0-4f53-8940-20f92aaee320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:06.479888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971bb43-fee0-4f53-8940-20f92aaee320 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:06.480728 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971bb43-fee0-4f53-8940-20f92aaee320 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=65aba574c5cb4982a3ea8d305df35bb6, user.id=aeb23c010755413aa206c8dff125dae6) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:16:06.481037 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971bb43-fee0-4f53-8940-20f92aaee320 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:06.483456 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971bb43-fee0-4f53-8940-20f92aaee320 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:06.489224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 572/1159] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:16:06 2022] GET /identity/v3/role_assignments?user.id=aeb23c010755413aa206c8dff125dae6&scope.project.id=65aba574c5cb4982a3ea8d305df35bb6&role.id=0e45946c6336419abb2015d8916e31ca => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:16:08.818130 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e16d40-c290-4617-965c-4eddcdaa2269 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:08.818778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e16d40-c290-4617-965c-4eddcdaa2269 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:08.818778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e16d40-c290-4617-965c-4eddcdaa2269 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:08.820582 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 588/1160] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:16:08.825757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b028b2-52e0-4c51-966c-223e438fafa8 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:08.826204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b028b2-52e0-4c51-966c-223e438fafa8 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:08.826358 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b028b2-52e0-4c51-966c-223e438fafa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:08.843982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-57b028b2-52e0-4c51-966c-223e438fafa8 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:16:08.845161 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-57b028b2-52e0-4c51-966c-223e438fafa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:16:08.852720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 573/1161] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:16:08 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:16:08.875830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e16d40-c290-4617-965c-4eddcdaa2269 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:08.887513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e16d40-c290-4617-965c-4eddcdaa2269 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:08.892153 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7557f11-3410-4381-ab74-830620901b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:08.892759 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7557f11-3410-4381-ab74-830620901b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:08.893035 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7557f11-3410-4381-ab74-830620901b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:08.893307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7557f11-3410-4381-ab74-830620901b8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:08.900691 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7557f11-3410-4381-ab74-830620901b8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:08.902413 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7557f11-3410-4381-ab74-830620901b8b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:08.911537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 589/1162] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:16:08 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:16:08.917075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b028b2-52e0-4c51-966c-223e438fafa8 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:08.926790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b028b2-52e0-4c51-966c-223e438fafa8 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:08.931245 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417b399-70d8-4388-bb99-9496823485f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:08.932055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417b399-70d8-4388-bb99-9496823485f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:08.932373 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417b399-70d8-4388-bb99-9496823485f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:08.932649 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417b399-70d8-4388-bb99-9496823485f1 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:08.939882 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417b399-70d8-4388-bb99-9496823485f1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:08.941727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417b399-70d8-4388-bb99-9496823485f1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:08.956545 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-0417b399-70d8-4388-bb99-9496823485f1 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 16 09:16:08.957720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 574/1163] 10.222.0.90 () {56 vars in 1138 bytes} [Wed Feb 16 09:16:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:16:08.968196 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7557f11-3410-4381-ab74-830620901b8b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:08.977414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7557f11-3410-4381-ab74-830620901b8b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:08.981868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553ba96-a18c-4111-931b-2d96d83a7c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:08.983183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ba96-a18c-4111-931b-2d96d83a7c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:08.983545 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ba96-a18c-4111-931b-2d96d83a7c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:08.983828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553ba96-a18c-4111-931b-2d96d83a7c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:08.984573 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553ba96-a18c-4111-931b-2d96d83a7c8b admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:16:08.984878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553ba96-a18c-4111-931b-2d96d83a7c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:08.986733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553ba96-a18c-4111-931b-2d96d83a7c8b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:08.993800 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 590/1164] 10.222.0.90 () {56 vars in 1136 bytes} [Wed Feb 16 09:16:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:11.253045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6054f-a026-4945-8405-36b8be577643 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:11.253607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6054f-a026-4945-8405-36b8be577643 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:11.253607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6054f-a026-4945-8405-36b8be577643 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:11.255371 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 575/1165] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:16:11.260513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ca384-7e1b-4302-8986-684bee347894 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:11.260939 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ca384-7e1b-4302-8986-684bee347894 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:11.261047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ca384-7e1b-4302-8986-684bee347894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:11.279112 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-784ca384-7e1b-4302-8986-684bee347894 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:16:11.280351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-784ca384-7e1b-4302-8986-684bee347894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:16:11.287754 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 591/1166] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:16:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:16:11.311625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6054f-a026-4945-8405-36b8be577643 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:11.323542 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6054f-a026-4945-8405-36b8be577643 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:11.329005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61aa197-637b-464a-b701-c374892896fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:11.329634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aa197-637b-464a-b701-c374892896fc admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:11.329914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aa197-637b-464a-b701-c374892896fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:11.330185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aa197-637b-464a-b701-c374892896fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:11.330918 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61aa197-637b-464a-b701-c374892896fc admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:11.331919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-b61aa197-637b-464a-b701-c374892896fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:16:11.331919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:16:11.331919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:16:11.332829 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61aa197-637b-464a-b701-c374892896fc admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:11.347176 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 576/1167] 10.222.0.90 () {60 vars in 1159 bytes} [Wed Feb 16 09:16:11 2022] POST /identity/v3/domains => generated 267 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:16:13.677079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c431c3-9a4e-4fb8-9858-584bd7802499 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:13.677649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c431c3-9a4e-4fb8-9858-584bd7802499 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:13.677649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c431c3-9a4e-4fb8-9858-584bd7802499 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:13.679380 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 592/1168] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:16:13.684514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf66b9a-b1ff-4692-82aa-81dc9ecd7a5f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:13.684920 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf66b9a-b1ff-4692-82aa-81dc9ecd7a5f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:13.685072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf66b9a-b1ff-4692-82aa-81dc9ecd7a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:13.704608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-9cf66b9a-b1ff-4692-82aa-81dc9ecd7a5f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:16:13.705810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9cf66b9a-b1ff-4692-82aa-81dc9ecd7a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:16:13.761279 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 577/1169] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:16:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:16:13.785877 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c431c3-9a4e-4fb8-9858-584bd7802499 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:13.798293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c431c3-9a4e-4fb8-9858-584bd7802499 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:13.802693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde88770-2989-49f9-9075-23114046f459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:13.803521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde88770-2989-49f9-9075-23114046f459 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:13.803802 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde88770-2989-49f9-9075-23114046f459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:13.804114 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde88770-2989-49f9-9075-23114046f459 admin admin] PATH_INFO: `/v3/domains/c4c0355b894f47218a8ab66c38232642` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:13.814549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde88770-2989-49f9-9075-23114046f459 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=c4c0355b894f47218a8ab66c38232642)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:13.816566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde88770-2989-49f9-9075-23114046f459 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:13.818187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 593/1170] 10.222.0.90 () {56 vars in 1204 bytes} [Wed Feb 16 09:16:13 2022] GET /identity/v3/domains/c4c0355b894f47218a8ab66c38232642 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:13.823726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf66b9a-b1ff-4692-82aa-81dc9ecd7a5f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:13.833065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf66b9a-b1ff-4692-82aa-81dc9ecd7a5f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:13.837625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0017f66-7121-4e1f-9646-a98491ad5a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:13.838260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017f66-7121-4e1f-9646-a98491ad5a3e admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:13.838544 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017f66-7121-4e1f-9646-a98491ad5a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:13.838820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0017f66-7121-4e1f-9646-a98491ad5a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:13.839514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0017f66-7121-4e1f-9646-a98491ad5a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:13.841448 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0017f66-7121-4e1f-9646-a98491ad5a3e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:13.866941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 578/1171] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:16:13 2022] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:16:16.195847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ccf6-130d-4f68-bde8-90946310a204 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:16.196439 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ccf6-130d-4f68-bde8-90946310a204 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:16.196590 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ccf6-130d-4f68-bde8-90946310a204 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:16.198522 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 594/1172] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:16:16.203903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4387b75-f782-41aa-a58f-593d6a74f2e8 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:16.204376 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4387b75-f782-41aa-a58f-593d6a74f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:16.204471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4387b75-f782-41aa-a58f-593d6a74f2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:16.221802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a4387b75-f782-41aa-a58f-593d6a74f2e8 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:16:16.222957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a4387b75-f782-41aa-a58f-593d6a74f2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:16:16.277806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 579/1173] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:16:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:16:16.303857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114ccf6-130d-4f68-bde8-90946310a204 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:16.316722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114ccf6-130d-4f68-bde8-90946310a204 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:16.321158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a09620-7ae5-440d-931b-96aaa74eeeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:16.321985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a09620-7ae5-440d-931b-96aaa74eeeff admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:16.322312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a09620-7ae5-440d-931b-96aaa74eeeff admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:16.322586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a09620-7ae5-440d-931b-96aaa74eeeff admin admin] PATH_INFO: `/v3/domains/c4c0355b894f47218a8ab66c38232642` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:16.323788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a09620-7ae5-440d-931b-96aaa74eeeff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=c4c0355b894f47218a8ab66c38232642)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:16.325809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a09620-7ae5-440d-931b-96aaa74eeeff admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:16.327528 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 595/1174] 10.222.0.90 () {56 vars in 1204 bytes} [Wed Feb 16 09:16:16 2022] GET /identity/v3/domains/c4c0355b894f47218a8ab66c38232642 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:16.332975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4387b75-f782-41aa-a58f-593d6a74f2e8 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:16.342314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4387b75-f782-41aa-a58f-593d6a74f2e8 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:16.347020 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0309db8-af23-4138-b6f2-bd2974757c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:16.347674 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0309db8-af23-4138-b6f2-bd2974757c99 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:16.347948 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0309db8-af23-4138-b6f2-bd2974757c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:16.348255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0309db8-af23-4138-b6f2-bd2974757c99 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:16.348983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0309db8-af23-4138-b6f2-bd2974757c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:16.350867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0309db8-af23-4138-b6f2-bd2974757c99 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:16.371636 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 580/1175] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:16:16 2022] POST /identity/v3/users => generated 311 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:16:18.735141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4702-d52e-4ab3-9fb6-e0b550d07b6d None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:18.735683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4702-d52e-4ab3-9fb6-e0b550d07b6d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:18.735683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc4702-d52e-4ab3-9fb6-e0b550d07b6d None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:18.737641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 596/1176] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:16:18.742858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9963-d960-4169-a705-e5c2f5a6141c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:18.743262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9963-d960-4169-a705-e5c2f5a6141c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:18.743405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9963-d960-4169-a705-e5c2f5a6141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:18.760951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-7b8d9963-d960-4169-a705-e5c2f5a6141c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:16:18.762105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-7b8d9963-d960-4169-a705-e5c2f5a6141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:16:18.770651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 581/1177] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:16:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:16:18.793486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc4702-d52e-4ab3-9fb6-e0b550d07b6d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:18.805464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc4702-d52e-4ab3-9fb6-e0b550d07b6d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:18.809781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed406-3c38-46ba-a105-0b99741d1ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:18.811070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed406-3c38-46ba-a105-0b99741d1ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:18.811368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed406-3c38-46ba-a105-0b99741d1ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:18.811653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed406-3c38-46ba-a105-0b99741d1ed6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:18.822112 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ed406-3c38-46ba-a105-0b99741d1ed6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:16:18.829674 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-e47ed406-3c38-46ba-a105-0b99741d1ed6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:16:18.830818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 597/1178] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:16:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:16:18.836523 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9963-d960-4169-a705-e5c2f5a6141c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:18.845420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9963-d960-4169-a705-e5c2f5a6141c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:18.849923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fde42-47a7-4f6a-9bfc-3c10081b8211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:18.850570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fde42-47a7-4f6a-9bfc-3c10081b8211 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:18.850853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fde42-47a7-4f6a-9bfc-3c10081b8211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:18.851129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fde42-47a7-4f6a-9bfc-3c10081b8211 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:18.851864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fde42-47a7-4f6a-9bfc-3c10081b8211 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:16:18.852212 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fde42-47a7-4f6a-9bfc-3c10081b8211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:18.853796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fde42-47a7-4f6a-9bfc-3c10081b8211 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:18.861959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 582/1179] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:16:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:18.867228 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed406-3c38-46ba-a105-0b99741d1ed6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:18.877217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed406-3c38-46ba-a105-0b99741d1ed6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:18.881684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4ae4d-118b-475d-b2f2-17c5bb3ca73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:18.882526 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4ae4d-118b-475d-b2f2-17c5bb3ca73c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:18.882806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4ae4d-118b-475d-b2f2-17c5bb3ca73c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:18.883081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4ae4d-118b-475d-b2f2-17c5bb3ca73c admin admin] PATH_INFO: `/v3/users/dbc0361bd1d4414bb3c91a8cc7f1acdb` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:18.897814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4ae4d-118b-475d-b2f2-17c5bb3ca73c admin admin] RBAC: Authorizing `identity:get_user(user_id=dbc0361bd1d4414bb3c91a8cc7f1acdb)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:18.899909 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4ae4d-118b-475d-b2f2-17c5bb3ca73c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:18.901521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 598/1180] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:16:18 2022] GET /identity/v3/users/dbc0361bd1d4414bb3c91a8cc7f1acdb => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:18.907012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fde42-47a7-4f6a-9bfc-3c10081b8211 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:18.916339 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fde42-47a7-4f6a-9bfc-3c10081b8211 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:18.920849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc649863-cff8-469b-aa3a-e6b9cc054ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:18.921460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc649863-cff8-469b-aa3a-e6b9cc054ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:18.921742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc649863-cff8-469b-aa3a-e6b9cc054ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:18.922018 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc649863-cff8-469b-aa3a-e6b9cc054ae4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:18.929519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc649863-cff8-469b-aa3a-e6b9cc054ae4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:18.931240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc649863-cff8-469b-aa3a-e6b9cc054ae4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:18.940449 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 583/1181] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:16:18 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:16:18.945800 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4ae4d-118b-475d-b2f2-17c5bb3ca73c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:18.955923 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4ae4d-118b-475d-b2f2-17c5bb3ca73c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:18.960371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c7d03-a3f3-4376-977f-1b16436e64ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:18.961188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c7d03-a3f3-4376-977f-1b16436e64ae admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:18.961464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c7d03-a3f3-4376-977f-1b16436e64ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:18.961733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c7d03-a3f3-4376-977f-1b16436e64ae admin admin] PATH_INFO: `/v3/projects/87223f0d8ef5447e8881d5b697ea6af6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:18.962871 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c7d03-a3f3-4376-977f-1b16436e64ae admin admin] RBAC: Authorizing `identity:get_project(project_id=87223f0d8ef5447e8881d5b697ea6af6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:18.964901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c7d03-a3f3-4376-977f-1b16436e64ae admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:18.966494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 599/1182] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:16:18 2022] GET /identity/v3/projects/87223f0d8ef5447e8881d5b697ea6af6 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:18.972216 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc649863-cff8-469b-aa3a-e6b9cc054ae4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:18.980649 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc649863-cff8-469b-aa3a-e6b9cc054ae4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:18.985878 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b2360-0818-4e93-b128-8a67e62bab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:18.986464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b2360-0818-4e93-b128-8a67e62bab43 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:18.986745 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b2360-0818-4e93-b128-8a67e62bab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:18.987020 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b2360-0818-4e93-b128-8a67e62bab43 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:18.987824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b2360-0818-4e93-b128-8a67e62bab43 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=87223f0d8ef5447e8881d5b697ea6af6, user.id=dbc0361bd1d4414bb3c91a8cc7f1acdb) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:16:18.988172 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b2360-0818-4e93-b128-8a67e62bab43 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:18.989960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b2360-0818-4e93-b128-8a67e62bab43 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:18.995114 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 584/1183] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:16:18 2022] GET /identity/v3/role_assignments?user.id=dbc0361bd1d4414bb3c91a8cc7f1acdb&scope.project.id=87223f0d8ef5447e8881d5b697ea6af6&role.id=0e45946c6336419abb2015d8916e31ca => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:21.238282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d01ca-2aa7-492f-8b27-bb9db2e6b082 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:21.238815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d01ca-2aa7-492f-8b27-bb9db2e6b082 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:21.238815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d01ca-2aa7-492f-8b27-bb9db2e6b082 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:21.240586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 600/1184] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:16:21.245841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a1b34-2b03-47a9-b279-7f323c2b6c51 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:21.246274 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a1b34-2b03-47a9-b279-7f323c2b6c51 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:21.246380 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a1b34-2b03-47a9-b279-7f323c2b6c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:21.264784 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-8f6a1b34-2b03-47a9-b279-7f323c2b6c51 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:16:21.265865 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8f6a1b34-2b03-47a9-b279-7f323c2b6c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:16:21.273671 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 585/1185] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:16:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:16:21.297615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d01ca-2aa7-492f-8b27-bb9db2e6b082 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:21.309300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d01ca-2aa7-492f-8b27-bb9db2e6b082 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:21.314425 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c0552-812b-4c6f-ac13-755586a7deb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:21.315179 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c0552-812b-4c6f-ac13-755586a7deb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:21.315454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c0552-812b-4c6f-ac13-755586a7deb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:21.315720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c0552-812b-4c6f-ac13-755586a7deb9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:21.325612 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c0552-812b-4c6f-ac13-755586a7deb9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:16:21.332578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-d23c0552-812b-4c6f-ac13-755586a7deb9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:16:21.333697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 601/1186] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:16:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:16:21.339250 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a1b34-2b03-47a9-b279-7f323c2b6c51 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:21.348647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a1b34-2b03-47a9-b279-7f323c2b6c51 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:21.353150 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419083a3-09fd-475c-a63e-a03651f4f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:21.353797 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419083a3-09fd-475c-a63e-a03651f4f7dd admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:21.354078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419083a3-09fd-475c-a63e-a03651f4f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:21.354353 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419083a3-09fd-475c-a63e-a03651f4f7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:21.355084 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419083a3-09fd-475c-a63e-a03651f4f7dd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:16:21.355389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419083a3-09fd-475c-a63e-a03651f4f7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:21.356997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419083a3-09fd-475c-a63e-a03651f4f7dd admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:21.365790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 586/1187] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:16:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:21.371326 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c0552-812b-4c6f-ac13-755586a7deb9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:21.381496 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c0552-812b-4c6f-ac13-755586a7deb9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:21.385913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240178f4-4b6d-406b-8764-6cc29d653ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:21.386741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240178f4-4b6d-406b-8764-6cc29d653ade admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:21.387015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240178f4-4b6d-406b-8764-6cc29d653ade admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:21.387282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240178f4-4b6d-406b-8764-6cc29d653ade admin admin] PATH_INFO: `/v3/users/dbc0361bd1d4414bb3c91a8cc7f1acdb` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:21.388474 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240178f4-4b6d-406b-8764-6cc29d653ade admin admin] RBAC: Authorizing `identity:get_user(user_id=dbc0361bd1d4414bb3c91a8cc7f1acdb)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:21.390710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240178f4-4b6d-406b-8764-6cc29d653ade admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:21.392576 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 602/1188] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:16:21 2022] GET /identity/v3/users/dbc0361bd1d4414bb3c91a8cc7f1acdb => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:21.398435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419083a3-09fd-475c-a63e-a03651f4f7dd admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:21.408808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419083a3-09fd-475c-a63e-a03651f4f7dd admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:21.413420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073e75c-b1c9-43b5-8c05-0375e9aade86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:21.414256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073e75c-b1c9-43b5-8c05-0375e9aade86 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:21.414537 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073e75c-b1c9-43b5-8c05-0375e9aade86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:21.414810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073e75c-b1c9-43b5-8c05-0375e9aade86 admin admin] PATH_INFO: `/v3/projects/87223f0d8ef5447e8881d5b697ea6af6` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:21.415978 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073e75c-b1c9-43b5-8c05-0375e9aade86 admin admin] RBAC: Authorizing `identity:get_project(project_id=87223f0d8ef5447e8881d5b697ea6af6)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:21.418047 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073e75c-b1c9-43b5-8c05-0375e9aade86 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:21.419718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 587/1189] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:16:21 2022] GET /identity/v3/projects/87223f0d8ef5447e8881d5b697ea6af6 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:21.426263 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240178f4-4b6d-406b-8764-6cc29d653ade admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:21.436801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240178f4-4b6d-406b-8764-6cc29d653ade admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:21.441180 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00129439-c8dc-4ee1-93f5-fec3f47ce7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:21.442022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129439-c8dc-4ee1-93f5-fec3f47ce7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:21.442293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129439-c8dc-4ee1-93f5-fec3f47ce7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:21.442557 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00129439-c8dc-4ee1-93f5-fec3f47ce7d8 admin admin] PATH_INFO: `/v3/projects/87223f0d8ef5447e8881d5b697ea6af6/users/dbc0361bd1d4414bb3c91a8cc7f1acdb/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:21.444467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00129439-c8dc-4ee1-93f5-fec3f47ce7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87223f0d8ef5447e8881d5b697ea6af6, user_id=dbc0361bd1d4414bb3c91a8cc7f1acdb, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:21.447051 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00129439-c8dc-4ee1-93f5-fec3f47ce7d8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:21.459319 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 603/1190] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:16:21 2022] PUT /identity/v3/projects/87223f0d8ef5447e8881d5b697ea6af6/users/dbc0361bd1d4414bb3c91a8cc7f1acdb/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:16:23.806663 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c34045-7510-4b23-8753-2639bdc83261 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:23.807211 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c34045-7510-4b23-8753-2639bdc83261 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:23.807211 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c34045-7510-4b23-8753-2639bdc83261 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:23.809067 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 588/1191] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:16:23.815124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371c4f2-b6d5-4909-960a-247d2aaaa142 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:23.815554 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371c4f2-b6d5-4909-960a-247d2aaaa142 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:23.815668 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371c4f2-b6d5-4909-960a-247d2aaaa142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:23.833278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5371c4f2-b6d5-4909-960a-247d2aaaa142 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:16:23.834447 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5371c4f2-b6d5-4909-960a-247d2aaaa142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:16:23.889676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 604/1192] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:16:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:16:23.914241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c34045-7510-4b23-8753-2639bdc83261 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:23.926661 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c34045-7510-4b23-8753-2639bdc83261 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:23.930994 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ee9cb-d977-4a7c-bd40-081c0f32a67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:23.931752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ee9cb-d977-4a7c-bd40-081c0f32a67c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:23.932052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ee9cb-d977-4a7c-bd40-081c0f32a67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:23.932329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ee9cb-d977-4a7c-bd40-081c0f32a67c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:23.943262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ee9cb-d977-4a7c-bd40-081c0f32a67c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:16:23.949947 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-c89ee9cb-d977-4a7c-bd40-081c0f32a67c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:16:23.951077 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 589/1193] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:16:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:16:23.958289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371c4f2-b6d5-4909-960a-247d2aaaa142 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:23.967720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371c4f2-b6d5-4909-960a-247d2aaaa142 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:23.972375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26311828-28c9-4d89-b01e-2efdc8548ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:23.973040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26311828-28c9-4d89-b01e-2efdc8548ede admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:23.973341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26311828-28c9-4d89-b01e-2efdc8548ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:23.973617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26311828-28c9-4d89-b01e-2efdc8548ede admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:23.974375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26311828-28c9-4d89-b01e-2efdc8548ede admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:16:23.974678 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26311828-28c9-4d89-b01e-2efdc8548ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:23.976317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26311828-28c9-4d89-b01e-2efdc8548ede admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:23.985125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 605/1194] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:16:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:23.990996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ee9cb-d977-4a7c-bd40-081c0f32a67c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:24.001143 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ee9cb-d977-4a7c-bd40-081c0f32a67c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:24.005623 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b58075-1473-46e6-b53b-bb9b857d7800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:24.006438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b58075-1473-46e6-b53b-bb9b857d7800 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:24.006710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b58075-1473-46e6-b53b-bb9b857d7800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:24.006978 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b58075-1473-46e6-b53b-bb9b857d7800 admin admin] PATH_INFO: `/v3/users/dbc0361bd1d4414bb3c91a8cc7f1acdb` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:24.008164 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b58075-1473-46e6-b53b-bb9b857d7800 admin admin] RBAC: Authorizing `identity:get_user(user_id=dbc0361bd1d4414bb3c91a8cc7f1acdb)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:24.010264 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b58075-1473-46e6-b53b-bb9b857d7800 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:24.011836 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 590/1195] 10.222.0.90 () {56 vars in 1198 bytes} [Wed Feb 16 09:16:23 2022] GET /identity/v3/users/dbc0361bd1d4414bb3c91a8cc7f1acdb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:16:24.018158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26311828-28c9-4d89-b01e-2efdc8548ede admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:24.028005 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26311828-28c9-4d89-b01e-2efdc8548ede admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:24.033374 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722dd65-4e76-45ff-876a-25b20f9ac26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:24.034021 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722dd65-4e76-45ff-876a-25b20f9ac26e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:24.034333 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722dd65-4e76-45ff-876a-25b20f9ac26e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:24.034584 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722dd65-4e76-45ff-876a-25b20f9ac26e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:24.042781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722dd65-4e76-45ff-876a-25b20f9ac26e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:24.044577 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722dd65-4e76-45ff-876a-25b20f9ac26e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:24.058546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 606/1196] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:16:24 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:16:24.066398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b58075-1473-46e6-b53b-bb9b857d7800 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:24.076707 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b58075-1473-46e6-b53b-bb9b857d7800 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:24.081909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b599a70-5d37-4deb-87a4-f4f02c3c0bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:24.082861 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b599a70-5d37-4deb-87a4-f4f02c3c0bac admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:24.083141 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b599a70-5d37-4deb-87a4-f4f02c3c0bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:24.083413 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b599a70-5d37-4deb-87a4-f4f02c3c0bac admin admin] PATH_INFO: `/v3/projects/87223f0d8ef5447e8881d5b697ea6af6` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:24.084610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b599a70-5d37-4deb-87a4-f4f02c3c0bac admin admin] RBAC: Authorizing `identity:get_project(project_id=87223f0d8ef5447e8881d5b697ea6af6)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:24.086651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b599a70-5d37-4deb-87a4-f4f02c3c0bac admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:24.088386 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 591/1197] 10.222.0.90 () {56 vars in 1207 bytes} [Wed Feb 16 09:16:24 2022] GET /identity/v3/projects/87223f0d8ef5447e8881d5b697ea6af6 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:16:24.096768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722dd65-4e76-45ff-876a-25b20f9ac26e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:16:24.105801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722dd65-4e76-45ff-876a-25b20f9ac26e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:16:24.111585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77057424-f90f-447e-ad36-6a0ffd75a512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:16:24.112315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77057424-f90f-447e-ad36-6a0ffd75a512 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:16:24.112634 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77057424-f90f-447e-ad36-6a0ffd75a512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:16:24.112925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77057424-f90f-447e-ad36-6a0ffd75a512 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:16:24.113802 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77057424-f90f-447e-ad36-6a0ffd75a512 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=87223f0d8ef5447e8881d5b697ea6af6, user.id=dbc0361bd1d4414bb3c91a8cc7f1acdb) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:16:24.114147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77057424-f90f-447e-ad36-6a0ffd75a512 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:16:24.116059 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77057424-f90f-447e-ad36-6a0ffd75a512 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:16:24.124727 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 607/1198] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:16:24 2022] GET /identity/v3/role_assignments?user.id=dbc0361bd1d4414bb3c91a8cc7f1acdb&scope.project.id=87223f0d8ef5447e8881d5b697ea6af6&role.id=0e45946c6336419abb2015d8916e31ca => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:27.416435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cf421-0f9e-4252-afbb-c899bdc5d849 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:27.417045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cf421-0f9e-4252-afbb-c899bdc5d849 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:27.417045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cf421-0f9e-4252-afbb-c899bdc5d849 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:27.419388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 592/1199] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:17:27.426388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd6ad4-c11a-4425-9876-30842bcfabb6 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:27.426949 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd6ad4-c11a-4425-9876-30842bcfabb6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:27.426949 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd6ad4-c11a-4425-9876-30842bcfabb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:27.447381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b9bd6ad4-c11a-4425-9876-30842bcfabb6 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:17:27.448700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b9bd6ad4-c11a-4425-9876-30842bcfabb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:17:27.459448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 608/1200] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:17:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:17:27.488042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cf421-0f9e-4252-afbb-c899bdc5d849 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:27.502956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cf421-0f9e-4252-afbb-c899bdc5d849 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:27.508374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06740487-d638-4af4-acdd-10b460609684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:27.509389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06740487-d638-4af4-acdd-10b460609684 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:27.509839 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06740487-d638-4af4-acdd-10b460609684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:27.510100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06740487-d638-4af4-acdd-10b460609684 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:27.522585 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06740487-d638-4af4-acdd-10b460609684 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:27.524527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06740487-d638-4af4-acdd-10b460609684 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:27.542702 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-06740487-d638-4af4-acdd-10b460609684 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:27.548060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 593/1201] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:27.550555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd6ad4-c11a-4425-9876-30842bcfabb6 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:27.566052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd6ad4-c11a-4425-9876-30842bcfabb6 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:27.571129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c609c7c-b6cd-447e-997f-50845172cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:27.571793 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c609c7c-b6cd-447e-997f-50845172cafe admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:27.572103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c609c7c-b6cd-447e-997f-50845172cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:27.572376 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c609c7c-b6cd-447e-997f-50845172cafe admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:27.573374 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c609c7c-b6cd-447e-997f-50845172cafe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:27.573665 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c609c7c-b6cd-447e-997f-50845172cafe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:27.575734 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c609c7c-b6cd-447e-997f-50845172cafe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:27.600068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 609/1202] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:27.603481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06740487-d638-4af4-acdd-10b460609684 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:27.616018 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06740487-d638-4af4-acdd-10b460609684 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:27.621831 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30586ce-2727-4dce-9e60-1d717535e1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:27.622526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30586ce-2727-4dce-9e60-1d717535e1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:27.622813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30586ce-2727-4dce-9e60-1d717535e1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:27.623091 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30586ce-2727-4dce-9e60-1d717535e1f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:27.623985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30586ce-2727-4dce-9e60-1d717535e1f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:27.626238 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30586ce-2727-4dce-9e60-1d717535e1f0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:27.648458 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 594/1203] 10.222.0.90 () {60 vars in 1153 bytes} [Wed Feb 16 09:17:27 2022] POST /identity/v3/users => generated 251 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:17:30.319794 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc67614-d204-4f94-9eae-03a8eae4b606 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.320433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc67614-d204-4f94-9eae-03a8eae4b606 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.320433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc67614-d204-4f94-9eae-03a8eae4b606 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.322653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 610/1204] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:17:30.328525 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf052280-85cf-46c5-adc6-e0bcd1f13801 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.329079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf052280-85cf-46c5-adc6-e0bcd1f13801 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.329079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf052280-85cf-46c5-adc6-e0bcd1f13801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.349068 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-bf052280-85cf-46c5-adc6-e0bcd1f13801 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:17:30.350379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-bf052280-85cf-46c5-adc6-e0bcd1f13801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:17:30.372438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 595/1205] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:17:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:17:30.389424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc67614-d204-4f94-9eae-03a8eae4b606 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:30.408123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc67614-d204-4f94-9eae-03a8eae4b606 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:30.413429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f3ebc-f59b-4992-a8eb-9df4943b6e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:30.414386 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f3ebc-f59b-4992-a8eb-9df4943b6e53 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.414703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f3ebc-f59b-4992-a8eb-9df4943b6e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.414985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f3ebc-f59b-4992-a8eb-9df4943b6e53 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.428838 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f3ebc-f59b-4992-a8eb-9df4943b6e53 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:17:30.435740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-bb5f3ebc-f59b-4992-a8eb-9df4943b6e53 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:17:30.437321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 611/1206] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:17:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:30.444271 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf052280-85cf-46c5-adc6-e0bcd1f13801 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:30.455304 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf052280-85cf-46c5-adc6-e0bcd1f13801 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:30.460604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411c8a-a03a-49db-8107-c75a5447616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:30.461351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411c8a-a03a-49db-8107-c75a5447616e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.461649 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411c8a-a03a-49db-8107-c75a5447616e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.461998 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411c8a-a03a-49db-8107-c75a5447616e admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.462999 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29411c8a-a03a-49db-8107-c75a5447616e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:30.463311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29411c8a-a03a-49db-8107-c75a5447616e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:30.465173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29411c8a-a03a-49db-8107-c75a5447616e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:30.480072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 596/1207] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:17:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:30.481712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f3ebc-f59b-4992-a8eb-9df4943b6e53 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:30.491630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f3ebc-f59b-4992-a8eb-9df4943b6e53 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:30.496539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec080ab-a0c8-45f9-8e16-7542821858d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:30.497323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec080ab-a0c8-45f9-8e16-7542821858d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.497593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec080ab-a0c8-45f9-8e16-7542821858d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.497866 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec080ab-a0c8-45f9-8e16-7542821858d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.508789 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec080ab-a0c8-45f9-8e16-7542821858d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:30.510647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec080ab-a0c8-45f9-8e16-7542821858d3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:30.528775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-9ec080ab-a0c8-45f9-8e16-7542821858d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:30.529980 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 612/1208] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:30.536534 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411c8a-a03a-49db-8107-c75a5447616e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:30.547092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411c8a-a03a-49db-8107-c75a5447616e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:30.551728 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c5f7e-ab4c-44da-8884-9f652a202c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:30.552497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c5f7e-ab4c-44da-8884-9f652a202c18 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.552843 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c5f7e-ab4c-44da-8884-9f652a202c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.553119 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c5f7e-ab4c-44da-8884-9f652a202c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.553876 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c5f7e-ab4c-44da-8884-9f652a202c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:30.554195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c5f7e-ab4c-44da-8884-9f652a202c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:30.555885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c5f7e-ab4c-44da-8884-9f652a202c18 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:30.573770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 597/1209] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:30.575245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec080ab-a0c8-45f9-8e16-7542821858d3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:30.587285 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec080ab-a0c8-45f9-8e16-7542821858d3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:30.592554 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2972366-b95f-4845-88fc-fc3b47f21fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:30.593467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2972366-b95f-4845-88fc-fc3b47f21fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.593778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2972366-b95f-4845-88fc-fc3b47f21fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.594089 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2972366-b95f-4845-88fc-fc3b47f21fa7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.602233 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2972366-b95f-4845-88fc-fc3b47f21fa7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:30.604520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2972366-b95f-4845-88fc-fc3b47f21fa7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:30.621506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-d2972366-b95f-4845-88fc-fc3b47f21fa7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 09:17:30.622829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 613/1210] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:30.629212 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c5f7e-ab4c-44da-8884-9f652a202c18 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:30.640982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c5f7e-ab4c-44da-8884-9f652a202c18 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:30.646571 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564979d-9b8b-4705-907a-804a9be5e4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:30.647250 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564979d-9b8b-4705-907a-804a9be5e4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.647532 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564979d-9b8b-4705-907a-804a9be5e4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.647809 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564979d-9b8b-4705-907a-804a9be5e4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.649603 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564979d-9b8b-4705-907a-804a9be5e4f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:30.649603 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564979d-9b8b-4705-907a-804a9be5e4f8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:30.651845 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564979d-9b8b-4705-907a-804a9be5e4f8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:30.669811 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 598/1211] 10.222.0.90 () {56 vars in 1164 bytes} [Wed Feb 16 09:17:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:17:30.675733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2972366-b95f-4845-88fc-fc3b47f21fa7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:30.685770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2972366-b95f-4845-88fc-fc3b47f21fa7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:30.690889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8169313-722e-473f-9f4c-16b129cbf57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:30.691534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8169313-722e-473f-9f4c-16b129cbf57f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.691816 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8169313-722e-473f-9f4c-16b129cbf57f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.692127 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8169313-722e-473f-9f4c-16b129cbf57f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.700398 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8169313-722e-473f-9f4c-16b129cbf57f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:30.702801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8169313-722e-473f-9f4c-16b129cbf57f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:30.712239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 614/1212] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:17:30 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:17:30.718370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564979d-9b8b-4705-907a-804a9be5e4f8 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:30.729133 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564979d-9b8b-4705-907a-804a9be5e4f8 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:30.735089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11da58b-d552-4551-b654-53884b265799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:30.735942 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11da58b-d552-4551-b654-53884b265799 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.736245 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11da58b-d552-4551-b654-53884b265799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.736546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11da58b-d552-4551-b654-53884b265799 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.747673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11da58b-d552-4551-b654-53884b265799 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:30.749903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11da58b-d552-4551-b654-53884b265799 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:30.769989 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-a11da58b-d552-4551-b654-53884b265799 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:30.771400 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 599/1213] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:30.778088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8169313-722e-473f-9f4c-16b129cbf57f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:30.789994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8169313-722e-473f-9f4c-16b129cbf57f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:30.795651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268457-97eb-488e-aed1-cd857f8416e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:30.796917 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268457-97eb-488e-aed1-cd857f8416e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.797267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268457-97eb-488e-aed1-cd857f8416e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.797472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268457-97eb-488e-aed1-cd857f8416e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.798199 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268457-97eb-488e-aed1-cd857f8416e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:30.798500 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268457-97eb-488e-aed1-cd857f8416e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:30.800109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57268457-97eb-488e-aed1-cd857f8416e7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:30.813172 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 615/1214] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:30.818562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11da58b-d552-4551-b654-53884b265799 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:30.830762 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11da58b-d552-4551-b654-53884b265799 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:30.838118 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caac7a-404d-45f7-b0ad-87e50caa4ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:30.839062 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caac7a-404d-45f7-b0ad-87e50caa4ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.839392 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caac7a-404d-45f7-b0ad-87e50caa4ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.839668 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33caac7a-404d-45f7-b0ad-87e50caa4ca5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.851435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33caac7a-404d-45f7-b0ad-87e50caa4ca5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:30.851435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33caac7a-404d-45f7-b0ad-87e50caa4ca5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:30.867222 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-33caac7a-404d-45f7-b0ad-87e50caa4ca5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:17:30.869127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 600/1215] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:30.875551 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268457-97eb-488e-aed1-cd857f8416e7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:30.886566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57268457-97eb-488e-aed1-cd857f8416e7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:30.892208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71f6f6-e329-46aa-9f86-bcd749a91e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:30.892973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f6f6-e329-46aa-9f86-bcd749a91e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.893334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f6f6-e329-46aa-9f86-bcd749a91e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.893760 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71f6f6-e329-46aa-9f86-bcd749a91e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.894973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71f6f6-e329-46aa-9f86-bcd749a91e41 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:30.895361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71f6f6-e329-46aa-9f86-bcd749a91e41 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:30.897575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71f6f6-e329-46aa-9f86-bcd749a91e41 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:30.911111 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 616/1216] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:17:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:30.918199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caac7a-404d-45f7-b0ad-87e50caa4ca5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:30.933552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33caac7a-404d-45f7-b0ad-87e50caa4ca5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:30.938730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf407d16-9779-4e28-b374-932e02bd8c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:30.939484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf407d16-9779-4e28-b374-932e02bd8c34 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:30.939764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf407d16-9779-4e28-b374-932e02bd8c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:30.940061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf407d16-9779-4e28-b374-932e02bd8c34 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:30.940885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf407d16-9779-4e28-b374-932e02bd8c34 admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=7d870fbd90cb4fde9ceafd2b737795eb) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:30.941193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf407d16-9779-4e28-b374-932e02bd8c34 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:30.943225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf407d16-9779-4e28-b374-932e02bd8c34 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:30.949333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 601/1217] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:17:30 2022] GET /identity/v3/role_assignments?user.id=7d870fbd90cb4fde9ceafd2b737795eb&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:33.434872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f22cf4-6609-4939-a429-6451e33bdd63 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.435442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f22cf4-6609-4939-a429-6451e33bdd63 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.435442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f22cf4-6609-4939-a429-6451e33bdd63 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.439754 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 617/1218] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:17:33.443373 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101be15-c14c-45f2-b0e8-6e8c7e2ef8d0 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.443874 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101be15-c14c-45f2-b0e8-6e8c7e2ef8d0 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.443955 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101be15-c14c-45f2-b0e8-6e8c7e2ef8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.463238 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-1101be15-c14c-45f2-b0e8-6e8c7e2ef8d0 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:17:33.464570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1101be15-c14c-45f2-b0e8-6e8c7e2ef8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:17:33.474312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 602/1219] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:17:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:17:33.498474 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f22cf4-6609-4939-a429-6451e33bdd63 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:33.512445 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f22cf4-6609-4939-a429-6451e33bdd63 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:33.516992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380fa81-ea9b-4aa5-a4a2-dcfe7aea0418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:33.517777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380fa81-ea9b-4aa5-a4a2-dcfe7aea0418 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.518060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380fa81-ea9b-4aa5-a4a2-dcfe7aea0418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.518339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380fa81-ea9b-4aa5-a4a2-dcfe7aea0418 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.529012 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380fa81-ea9b-4aa5-a4a2-dcfe7aea0418 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:17:33.536392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-8380fa81-ea9b-4aa5-a4a2-dcfe7aea0418 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:17:33.537681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 618/1220] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:17:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:33.544059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101be15-c14c-45f2-b0e8-6e8c7e2ef8d0 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:33.554510 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101be15-c14c-45f2-b0e8-6e8c7e2ef8d0 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:33.559389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d77a03-2143-4041-b56a-ae3d8c30e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:33.560083 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77a03-2143-4041-b56a-ae3d8c30e754 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.560361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77a03-2143-4041-b56a-ae3d8c30e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.560628 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d77a03-2143-4041-b56a-ae3d8c30e754 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.561350 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d77a03-2143-4041-b56a-ae3d8c30e754 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:33.561749 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d77a03-2143-4041-b56a-ae3d8c30e754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:33.563423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d77a03-2143-4041-b56a-ae3d8c30e754 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:33.571990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 603/1221] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:17:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:33.578365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380fa81-ea9b-4aa5-a4a2-dcfe7aea0418 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:33.589255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380fa81-ea9b-4aa5-a4a2-dcfe7aea0418 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:33.594826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f6b70-3bca-4cbc-b8ff-b3073f3ce113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:33.595626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f6b70-3bca-4cbc-b8ff-b3073f3ce113 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.595853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f6b70-3bca-4cbc-b8ff-b3073f3ce113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.596158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f6b70-3bca-4cbc-b8ff-b3073f3ce113 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.606723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f6b70-3bca-4cbc-b8ff-b3073f3ce113 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:33.609223 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f6b70-3bca-4cbc-b8ff-b3073f3ce113 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:33.626210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-833f6b70-3bca-4cbc-b8ff-b3073f3ce113 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:33.627578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 619/1222] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:33.633340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d77a03-2143-4041-b56a-ae3d8c30e754 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:33.643569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d77a03-2143-4041-b56a-ae3d8c30e754 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:33.648752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a4406-45bd-4d51-9a1b-47379ba867ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:33.649415 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4406-45bd-4d51-9a1b-47379ba867ae admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.649690 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4406-45bd-4d51-9a1b-47379ba867ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.650092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a4406-45bd-4d51-9a1b-47379ba867ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.650791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a4406-45bd-4d51-9a1b-47379ba867ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:33.651091 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a4406-45bd-4d51-9a1b-47379ba867ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:33.652819 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a4406-45bd-4d51-9a1b-47379ba867ae admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:33.665400 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 604/1223] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:17:33.671857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f6b70-3bca-4cbc-b8ff-b3073f3ce113 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:33.682283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f6b70-3bca-4cbc-b8ff-b3073f3ce113 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:33.690726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c123d-eda7-4ab5-90b8-03bcbc587002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:33.690726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c123d-eda7-4ab5-90b8-03bcbc587002 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.690726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c123d-eda7-4ab5-90b8-03bcbc587002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.690726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c123d-eda7-4ab5-90b8-03bcbc587002 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.698442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c123d-eda7-4ab5-90b8-03bcbc587002 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:33.700877 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c123d-eda7-4ab5-90b8-03bcbc587002 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:33.716317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-008c123d-eda7-4ab5-90b8-03bcbc587002 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 09:17:33.718305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 620/1224] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:33.724475 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a4406-45bd-4d51-9a1b-47379ba867ae admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:33.736116 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a4406-45bd-4d51-9a1b-47379ba867ae admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:33.741685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12148078-d0a4-402a-a83d-bff4c319a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:33.742446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12148078-d0a4-402a-a83d-bff4c319a55b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.742810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12148078-d0a4-402a-a83d-bff4c319a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.743160 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12148078-d0a4-402a-a83d-bff4c319a55b admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.744001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12148078-d0a4-402a-a83d-bff4c319a55b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:33.744367 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12148078-d0a4-402a-a83d-bff4c319a55b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:33.746587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12148078-d0a4-402a-a83d-bff4c319a55b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:33.772108 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 605/1225] 10.222.0.90 () {56 vars in 1164 bytes} [Wed Feb 16 09:17:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:33.774097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c123d-eda7-4ab5-90b8-03bcbc587002 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:33.785403 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c123d-eda7-4ab5-90b8-03bcbc587002 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:33.790322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f7ac1-37c5-47ea-810a-54096b57daa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:33.791178 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f7ac1-37c5-47ea-810a-54096b57daa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.791461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f7ac1-37c5-47ea-810a-54096b57daa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.791731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f7ac1-37c5-47ea-810a-54096b57daa0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.803878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f7ac1-37c5-47ea-810a-54096b57daa0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:33.805824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f7ac1-37c5-47ea-810a-54096b57daa0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:33.825123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-8e4f7ac1-37c5-47ea-810a-54096b57daa0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:33.826622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 621/1226] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:33.832754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12148078-d0a4-402a-a83d-bff4c319a55b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:33.843278 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12148078-d0a4-402a-a83d-bff4c319a55b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:33.848142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24879722-4fdd-4a36-8c6c-e9d46e8e3e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:33.848817 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24879722-4fdd-4a36-8c6c-e9d46e8e3e58 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.849092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24879722-4fdd-4a36-8c6c-e9d46e8e3e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.849360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24879722-4fdd-4a36-8c6c-e9d46e8e3e58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.850078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24879722-4fdd-4a36-8c6c-e9d46e8e3e58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:33.850378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24879722-4fdd-4a36-8c6c-e9d46e8e3e58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:33.851980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24879722-4fdd-4a36-8c6c-e9d46e8e3e58 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:33.865240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 606/1227] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:33.870812 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f7ac1-37c5-47ea-810a-54096b57daa0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:33.880839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f7ac1-37c5-47ea-810a-54096b57daa0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:33.885635 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec78d63-7b79-40ad-99a2-0bf657966d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:33.886459 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec78d63-7b79-40ad-99a2-0bf657966d16 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.886742 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec78d63-7b79-40ad-99a2-0bf657966d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.887011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec78d63-7b79-40ad-99a2-0bf657966d16 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.895082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec78d63-7b79-40ad-99a2-0bf657966d16 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:33.897240 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec78d63-7b79-40ad-99a2-0bf657966d16 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:33.912618 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-8ec78d63-7b79-40ad-99a2-0bf657966d16 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:17:33.918784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 622/1228] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:17:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:33.920453 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24879722-4fdd-4a36-8c6c-e9d46e8e3e58 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:33.931401 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24879722-4fdd-4a36-8c6c-e9d46e8e3e58 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:33.936478 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b349eba-e239-42eb-9496-e54d1890c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:33.937434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b349eba-e239-42eb-9496-e54d1890c891 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.937910 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b349eba-e239-42eb-9496-e54d1890c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.938394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b349eba-e239-42eb-9496-e54d1890c891 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.939403 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b349eba-e239-42eb-9496-e54d1890c891 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:33.939913 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b349eba-e239-42eb-9496-e54d1890c891 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:33.942130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b349eba-e239-42eb-9496-e54d1890c891 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:33.961682 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 607/1229] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:17:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:33.963349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec78d63-7b79-40ad-99a2-0bf657966d16 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:33.976221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec78d63-7b79-40ad-99a2-0bf657966d16 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:33.981339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8c0f9-80e4-4b6f-8ad2-90cc1ce20bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:33.982287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8c0f9-80e4-4b6f-8ad2-90cc1ce20bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:33.982670 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8c0f9-80e4-4b6f-8ad2-90cc1ce20bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:33.982939 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8c0f9-80e4-4b6f-8ad2-90cc1ce20bfe admin admin] PATH_INFO: `/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/7d870fbd90cb4fde9ceafd2b737795eb/roles/068cd8712b8547b89967dd5d7964007b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:33.999646 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8c0f9-80e4-4b6f-8ad2-90cc1ce20bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ab51e6e2745658b252fbafdc2f8ef, user_id=7d870fbd90cb4fde9ceafd2b737795eb, role_id=068cd8712b8547b89967dd5d7964007b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:34.002350 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8c0f9-80e4-4b6f-8ad2-90cc1ce20bfe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:34.016100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 623/1230] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:17:33 2022] PUT /identity/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/7d870fbd90cb4fde9ceafd2b737795eb/roles/068cd8712b8547b89967dd5d7964007b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:17:36.376318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9397639-cd67-4cfc-85bd-07ff72751321 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:36.376938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9397639-cd67-4cfc-85bd-07ff72751321 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:36.376938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9397639-cd67-4cfc-85bd-07ff72751321 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:36.378651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 608/1231] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:17:36.384678 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d52ce8-6879-4d42-88d1-9fa0f344d893 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:36.385194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d52ce8-6879-4d42-88d1-9fa0f344d893 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:36.385571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d52ce8-6879-4d42-88d1-9fa0f344d893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:36.407850 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f2d52ce8-6879-4d42-88d1-9fa0f344d893 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:17:36.409300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f2d52ce8-6879-4d42-88d1-9fa0f344d893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:17:36.471229 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 624/1232] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:17:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:17:36.496407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9397639-cd67-4cfc-85bd-07ff72751321 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:36.510293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9397639-cd67-4cfc-85bd-07ff72751321 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:36.515504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182bf3b-d7b2-4313-a240-f63dc3909c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:36.516261 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182bf3b-d7b2-4313-a240-f63dc3909c74 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:36.516547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182bf3b-d7b2-4313-a240-f63dc3909c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:36.516821 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182bf3b-d7b2-4313-a240-f63dc3909c74 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:36.527445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182bf3b-d7b2-4313-a240-f63dc3909c74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:17:36.535022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-1182bf3b-d7b2-4313-a240-f63dc3909c74 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 09:17:36.536246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 609/1233] 10.222.0.90 () {56 vars in 1123 bytes} [Wed Feb 16 09:17:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:17:36.542520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d52ce8-6879-4d42-88d1-9fa0f344d893 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:36.553717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d52ce8-6879-4d42-88d1-9fa0f344d893 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:36.559827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c05e7-e172-458b-9ad8-0a2ec7205e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:36.560599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c05e7-e172-458b-9ad8-0a2ec7205e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:36.560879 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c05e7-e172-458b-9ad8-0a2ec7205e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:36.561170 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c05e7-e172-458b-9ad8-0a2ec7205e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:36.562862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c05e7-e172-458b-9ad8-0a2ec7205e24 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:36.563232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c05e7-e172-458b-9ad8-0a2ec7205e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:36.565262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c05e7-e172-458b-9ad8-0a2ec7205e24 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:36.580774 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 625/1234] 10.222.0.90 () {56 vars in 1124 bytes} [Wed Feb 16 09:17:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:36.581993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182bf3b-d7b2-4313-a240-f63dc3909c74 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:36.592319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182bf3b-d7b2-4313-a240-f63dc3909c74 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:36.597409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6287bd-5045-4bd4-9f41-80717ba0b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:36.598173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6287bd-5045-4bd4-9f41-80717ba0b4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:36.598454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6287bd-5045-4bd4-9f41-80717ba0b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:36.598721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6287bd-5045-4bd4-9f41-80717ba0b4a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:36.610679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6287bd-5045-4bd4-9f41-80717ba0b4a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:36.612477 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6287bd-5045-4bd4-9f41-80717ba0b4a8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:36.630136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-2d6287bd-5045-4bd4-9f41-80717ba0b4a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:36.631277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 610/1235] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:36.637333 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c05e7-e172-458b-9ad8-0a2ec7205e24 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:36.649705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c05e7-e172-458b-9ad8-0a2ec7205e24 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:36.654599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e0258-2fff-4931-8722-812c3dab15ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:36.655266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e0258-2fff-4931-8722-812c3dab15ab admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:36.655536 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e0258-2fff-4931-8722-812c3dab15ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:36.655826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e0258-2fff-4931-8722-812c3dab15ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:36.656543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e0258-2fff-4931-8722-812c3dab15ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:36.656845 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e0258-2fff-4931-8722-812c3dab15ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:36.658426 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e0258-2fff-4931-8722-812c3dab15ab admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:36.672194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 626/1236] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:36.677881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6287bd-5045-4bd4-9f41-80717ba0b4a8 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:36.691959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6287bd-5045-4bd4-9f41-80717ba0b4a8 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:36.697412 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840be8e-8d93-4f2f-95fd-f384255c7d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:36.698199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840be8e-8d93-4f2f-95fd-f384255c7d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:36.698474 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840be8e-8d93-4f2f-95fd-f384255c7d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:36.698740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840be8e-8d93-4f2f-95fd-f384255c7d88 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:36.707334 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840be8e-8d93-4f2f-95fd-f384255c7d88 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:36.709689 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840be8e-8d93-4f2f-95fd-f384255c7d88 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:36.726017 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-8840be8e-8d93-4f2f-95fd-f384255c7d88 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 09:17:36.727346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 611/1237] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:36.734035 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e0258-2fff-4931-8722-812c3dab15ab admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:36.745063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e0258-2fff-4931-8722-812c3dab15ab admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:36.751860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ff4e4-abf1-4805-aa6b-cf22b9f446fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:36.752559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ff4e4-abf1-4805-aa6b-cf22b9f446fe admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:36.752864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ff4e4-abf1-4805-aa6b-cf22b9f446fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:36.753216 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ff4e4-abf1-4805-aa6b-cf22b9f446fe admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:36.754142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ff4e4-abf1-4805-aa6b-cf22b9f446fe admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:36.754470 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ff4e4-abf1-4805-aa6b-cf22b9f446fe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:36.756669 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ff4e4-abf1-4805-aa6b-cf22b9f446fe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:36.776671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 627/1238] 10.222.0.90 () {56 vars in 1164 bytes} [Wed Feb 16 09:17:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:36.783202 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840be8e-8d93-4f2f-95fd-f384255c7d88 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:36.795209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840be8e-8d93-4f2f-95fd-f384255c7d88 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:36.800793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dec29-2a68-4dbc-b93d-44b1dd33f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:36.801451 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dec29-2a68-4dbc-b93d-44b1dd33f63d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:36.801728 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dec29-2a68-4dbc-b93d-44b1dd33f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:36.801996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dec29-2a68-4dbc-b93d-44b1dd33f63d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:36.810394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dec29-2a68-4dbc-b93d-44b1dd33f63d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:36.813242 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010dec29-2a68-4dbc-b93d-44b1dd33f63d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:36.823948 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 612/1239] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:17:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:17:36.831499 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ff4e4-abf1-4805-aa6b-cf22b9f446fe admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:36.842573 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ff4e4-abf1-4805-aa6b-cf22b9f446fe admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:36.847323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cc114-32cf-4acf-ba1f-9b41b3e40e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:36.848269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cc114-32cf-4acf-ba1f-9b41b3e40e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:36.848580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cc114-32cf-4acf-ba1f-9b41b3e40e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:36.848856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cc114-32cf-4acf-ba1f-9b41b3e40e89 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:36.860304 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cc114-32cf-4acf-ba1f-9b41b3e40e89 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:36.862420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cc114-32cf-4acf-ba1f-9b41b3e40e89 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:36.881916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-b86cc114-32cf-4acf-ba1f-9b41b3e40e89 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:36.883219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 628/1240] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:36.890795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dec29-2a68-4dbc-b93d-44b1dd33f63d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:36.900581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010dec29-2a68-4dbc-b93d-44b1dd33f63d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:36.905955 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aeab37-d3eb-477e-8b52-2beab32f9d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:36.906709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeab37-d3eb-477e-8b52-2beab32f9d5c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:36.907023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeab37-d3eb-477e-8b52-2beab32f9d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:36.907296 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeab37-d3eb-477e-8b52-2beab32f9d5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:36.908106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aeab37-d3eb-477e-8b52-2beab32f9d5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:36.908409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aeab37-d3eb-477e-8b52-2beab32f9d5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:36.910170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aeab37-d3eb-477e-8b52-2beab32f9d5c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:36.923434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 613/1241] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:36.929504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cc114-32cf-4acf-ba1f-9b41b3e40e89 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:36.940588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cc114-32cf-4acf-ba1f-9b41b3e40e89 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:36.945519 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14395940-b5e8-4d87-85d9-4895856e807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:36.946675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14395940-b5e8-4d87-85d9-4895856e807d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:36.947075 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14395940-b5e8-4d87-85d9-4895856e807d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:36.947391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14395940-b5e8-4d87-85d9-4895856e807d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:36.956744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14395940-b5e8-4d87-85d9-4895856e807d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:36.959287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14395940-b5e8-4d87-85d9-4895856e807d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:36.975957 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-14395940-b5e8-4d87-85d9-4895856e807d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:17:36.977924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 629/1242] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:36.983648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aeab37-d3eb-477e-8b52-2beab32f9d5c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:36.995503 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aeab37-d3eb-477e-8b52-2beab32f9d5c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:37.000281 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47996ed-f61e-47f7-a488-3380541074c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:37.000925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47996ed-f61e-47f7-a488-3380541074c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:37.001203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47996ed-f61e-47f7-a488-3380541074c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:37.001475 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47996ed-f61e-47f7-a488-3380541074c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:37.002248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47996ed-f61e-47f7-a488-3380541074c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:37.002560 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47996ed-f61e-47f7-a488-3380541074c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:37.004715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47996ed-f61e-47f7-a488-3380541074c2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:37.019033 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 614/1243] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:17:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:17:37.025329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14395940-b5e8-4d87-85d9-4895856e807d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:37.036320 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14395940-b5e8-4d87-85d9-4895856e807d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:37.040799 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46016b79-5e58-47d9-9e91-8583fe4706a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:37.041425 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46016b79-5e58-47d9-9e91-8583fe4706a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:37.041699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46016b79-5e58-47d9-9e91-8583fe4706a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:37.041967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46016b79-5e58-47d9-9e91-8583fe4706a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:37.042773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46016b79-5e58-47d9-9e91-8583fe4706a1 admin admin] RBAC: Adding query filter params (role.id=068cd8712b8547b89967dd5d7964007b, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=7d870fbd90cb4fde9ceafd2b737795eb) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:37.043078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46016b79-5e58-47d9-9e91-8583fe4706a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:37.044940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46016b79-5e58-47d9-9e91-8583fe4706a1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:37.051035 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 630/1244] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:17:37 2022] GET /identity/v3/role_assignments?user.id=7d870fbd90cb4fde9ceafd2b737795eb&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=068cd8712b8547b89967dd5d7964007b => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:39.535134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02eb86-a250-4d31-be6a-2984f1f0478a None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:39.535742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02eb86-a250-4d31-be6a-2984f1f0478a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:39.535742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02eb86-a250-4d31-be6a-2984f1f0478a None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:39.537480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 615/1245] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:17:39.543291 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9d4df-8c32-427e-bfce-2753061c9339 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:39.543798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9d4df-8c32-427e-bfce-2753061c9339 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:39.543893 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9d4df-8c32-427e-bfce-2753061c9339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:39.563919 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e1e9d4df-8c32-427e-bfce-2753061c9339 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:17:39.565215 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e1e9d4df-8c32-427e-bfce-2753061c9339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:17:39.573060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 631/1246] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:17:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:17:39.601761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02eb86-a250-4d31-be6a-2984f1f0478a None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:39.615612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02eb86-a250-4d31-be6a-2984f1f0478a None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:39.619987 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9580e57-0f8d-487e-b72c-c37c3a130a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:39.620844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9580e57-0f8d-487e-b72c-c37c3a130a6a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:39.621171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9580e57-0f8d-487e-b72c-c37c3a130a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:39.621482 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9580e57-0f8d-487e-b72c-c37c3a130a6a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:39.632888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9580e57-0f8d-487e-b72c-c37c3a130a6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:17:39.640864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-d9580e57-0f8d-487e-b72c-c37c3a130a6a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:17:39.642129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 616/1247] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:17:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:39.648444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9d4df-8c32-427e-bfce-2753061c9339 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:39.658005 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9d4df-8c32-427e-bfce-2753061c9339 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:39.662928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04265c5-674c-49e1-849b-cf23ec0208d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:39.663624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04265c5-674c-49e1-849b-cf23ec0208d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:39.663932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04265c5-674c-49e1-849b-cf23ec0208d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:39.664267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04265c5-674c-49e1-849b-cf23ec0208d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:39.665085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04265c5-674c-49e1-849b-cf23ec0208d9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:39.665443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04265c5-674c-49e1-849b-cf23ec0208d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:39.667059 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04265c5-674c-49e1-849b-cf23ec0208d9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:39.676561 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 632/1248] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:17:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:39.682549 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9580e57-0f8d-487e-b72c-c37c3a130a6a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:39.695807 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9580e57-0f8d-487e-b72c-c37c3a130a6a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:39.701547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d943f-f35b-434f-b3e1-146024200c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:39.703198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d943f-f35b-434f-b3e1-146024200c32 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:39.703623 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d943f-f35b-434f-b3e1-146024200c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:39.703943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d943f-f35b-434f-b3e1-146024200c32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:39.715512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d943f-f35b-434f-b3e1-146024200c32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:39.717390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d943f-f35b-434f-b3e1-146024200c32 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:39.737065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-320d943f-f35b-434f-b3e1-146024200c32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:39.738276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 617/1249] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:39.744402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04265c5-674c-49e1-849b-cf23ec0208d9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:39.755904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04265c5-674c-49e1-849b-cf23ec0208d9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:39.761371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd33b6-bf7f-43fe-bf1f-ee5f1aa6f8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:39.762144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd33b6-bf7f-43fe-bf1f-ee5f1aa6f8aa admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:39.762479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd33b6-bf7f-43fe-bf1f-ee5f1aa6f8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:39.762798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd33b6-bf7f-43fe-bf1f-ee5f1aa6f8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:39.763641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd33b6-bf7f-43fe-bf1f-ee5f1aa6f8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:39.763980 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd33b6-bf7f-43fe-bf1f-ee5f1aa6f8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:39.765875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd33b6-bf7f-43fe-bf1f-ee5f1aa6f8aa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:39.785452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 633/1250] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:17:39.786654 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d943f-f35b-434f-b3e1-146024200c32 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:39.798133 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d943f-f35b-434f-b3e1-146024200c32 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:39.803263 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33b480-073d-4ab6-b7d4-6d5db123c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:39.804137 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33b480-073d-4ab6-b7d4-6d5db123c9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:39.804425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33b480-073d-4ab6-b7d4-6d5db123c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:39.804704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33b480-073d-4ab6-b7d4-6d5db123c9d5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:39.812647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33b480-073d-4ab6-b7d4-6d5db123c9d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:39.814678 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33b480-073d-4ab6-b7d4-6d5db123c9d5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:39.829727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-5f33b480-073d-4ab6-b7d4-6d5db123c9d5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 09:17:39.830907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 618/1251] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:39.837454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd33b6-bf7f-43fe-bf1f-ee5f1aa6f8aa admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:39.849167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd33b6-bf7f-43fe-bf1f-ee5f1aa6f8aa admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:39.854743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeca9c6-a859-4b97-b395-59c50375ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:39.855522 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca9c6-a859-4b97-b395-59c50375ef78 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:39.855830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca9c6-a859-4b97-b395-59c50375ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:39.856169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca9c6-a859-4b97-b395-59c50375ef78 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:39.857084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeca9c6-a859-4b97-b395-59c50375ef78 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:39.857397 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeca9c6-a859-4b97-b395-59c50375ef78 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:39.860002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeca9c6-a859-4b97-b395-59c50375ef78 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:39.878461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 634/1252] 10.222.0.90 () {56 vars in 1164 bytes} [Wed Feb 16 09:17:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:17:39.884674 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33b480-073d-4ab6-b7d4-6d5db123c9d5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:39.897019 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33b480-073d-4ab6-b7d4-6d5db123c9d5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:39.901905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8e5b4-bea4-409d-bdc2-0cd8647127af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:39.902559 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8e5b4-bea4-409d-bdc2-0cd8647127af admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:39.902822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8e5b4-bea4-409d-bdc2-0cd8647127af admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:39.903094 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8e5b4-bea4-409d-bdc2-0cd8647127af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:39.912566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8e5b4-bea4-409d-bdc2-0cd8647127af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:39.914365 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8e5b4-bea4-409d-bdc2-0cd8647127af admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:39.924406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 619/1253] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:17:39 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:17:39.930300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeca9c6-a859-4b97-b395-59c50375ef78 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:39.940619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeca9c6-a859-4b97-b395-59c50375ef78 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:39.945268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56eca6-d57a-425b-94a1-9f6bdba099e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:39.946012 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56eca6-d57a-425b-94a1-9f6bdba099e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:39.946294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56eca6-d57a-425b-94a1-9f6bdba099e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:39.946565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56eca6-d57a-425b-94a1-9f6bdba099e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:39.960246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56eca6-d57a-425b-94a1-9f6bdba099e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:39.962247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56eca6-d57a-425b-94a1-9f6bdba099e6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:39.981249 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-df56eca6-d57a-425b-94a1-9f6bdba099e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:39.982473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 635/1254] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:17:39.988945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8e5b4-bea4-409d-bdc2-0cd8647127af admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:39.998903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8e5b4-bea4-409d-bdc2-0cd8647127af admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:40.004223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494bcbd-bb1a-4609-8935-bfd671687a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:40.004950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494bcbd-bb1a-4609-8935-bfd671687a8d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:40.005299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494bcbd-bb1a-4609-8935-bfd671687a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:40.005574 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494bcbd-bb1a-4609-8935-bfd671687a8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:40.006284 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494bcbd-bb1a-4609-8935-bfd671687a8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:40.006584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494bcbd-bb1a-4609-8935-bfd671687a8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:40.008204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494bcbd-bb1a-4609-8935-bfd671687a8d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:40.027952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 620/1255] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:17:40.029262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56eca6-d57a-425b-94a1-9f6bdba099e6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:40.040857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56eca6-d57a-425b-94a1-9f6bdba099e6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:40.046753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4cac7-7898-4855-bde7-e11dcb43962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:40.047554 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4cac7-7898-4855-bde7-e11dcb43962e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:40.047834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4cac7-7898-4855-bde7-e11dcb43962e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:40.048144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4cac7-7898-4855-bde7-e11dcb43962e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:40.055257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4cac7-7898-4855-bde7-e11dcb43962e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:40.057243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4cac7-7898-4855-bde7-e11dcb43962e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:40.071124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-77f4cac7-7898-4855-bde7-e11dcb43962e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:17:40.072323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 636/1256] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:17:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:40.079272 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494bcbd-bb1a-4609-8935-bfd671687a8d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:40.088990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494bcbd-bb1a-4609-8935-bfd671687a8d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:40.095148 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac43a8b-40bd-47b8-80a8-e6e91a596144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:40.095853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac43a8b-40bd-47b8-80a8-e6e91a596144 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:40.096165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac43a8b-40bd-47b8-80a8-e6e91a596144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:40.096438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac43a8b-40bd-47b8-80a8-e6e91a596144 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:40.097233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac43a8b-40bd-47b8-80a8-e6e91a596144 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:40.097527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac43a8b-40bd-47b8-80a8-e6e91a596144 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:40.099374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac43a8b-40bd-47b8-80a8-e6e91a596144 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:40.114032 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 621/1257] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:17:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:40.120251 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4cac7-7898-4855-bde7-e11dcb43962e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:40.134627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4cac7-7898-4855-bde7-e11dcb43962e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:40.140651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad7fbb-1e55-4deb-b649-07cad0d13b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:40.141389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad7fbb-1e55-4deb-b649-07cad0d13b75 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:40.141699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad7fbb-1e55-4deb-b649-07cad0d13b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:40.142035 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad7fbb-1e55-4deb-b649-07cad0d13b75 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:40.142990 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad7fbb-1e55-4deb-b649-07cad0d13b75 admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=7d870fbd90cb4fde9ceafd2b737795eb) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:40.143333 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad7fbb-1e55-4deb-b649-07cad0d13b75 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:40.145455 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad7fbb-1e55-4deb-b649-07cad0d13b75 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:40.151493 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 637/1258] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:17:40 2022] GET /identity/v3/role_assignments?user.id=7d870fbd90cb4fde9ceafd2b737795eb&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=0e45946c6336419abb2015d8916e31ca => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:17:42.550861 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf7de1-e2ee-4ff4-8cf6-f4ecbb71dfc4 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:42.551464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf7de1-e2ee-4ff4-8cf6-f4ecbb71dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:42.551464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf7de1-e2ee-4ff4-8cf6-f4ecbb71dfc4 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:42.556053 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 622/1259] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:17:42.558919 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f27eeb-4bd7-4441-ad18-ba28ccd3038a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:42.559396 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f27eeb-4bd7-4441-ad18-ba28ccd3038a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:42.559494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f27eeb-4bd7-4441-ad18-ba28ccd3038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:42.579349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-40f27eeb-4bd7-4441-ad18-ba28ccd3038a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:17:42.580595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-40f27eeb-4bd7-4441-ad18-ba28ccd3038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:17:42.588993 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 638/1260] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:17:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:17:42.614832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf7de1-e2ee-4ff4-8cf6-f4ecbb71dfc4 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:42.627900 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf7de1-e2ee-4ff4-8cf6-f4ecbb71dfc4 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:42.633019 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25f46b-6b58-49db-a126-559404409745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:42.633863 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25f46b-6b58-49db-a126-559404409745 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:42.634197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25f46b-6b58-49db-a126-559404409745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:42.634454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25f46b-6b58-49db-a126-559404409745 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:42.646348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25f46b-6b58-49db-a126-559404409745 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:17:42.653420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-2d25f46b-6b58-49db-a126-559404409745 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:17:42.654639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 623/1261] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:17:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:42.664063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f27eeb-4bd7-4441-ad18-ba28ccd3038a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:42.670576 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f27eeb-4bd7-4441-ad18-ba28ccd3038a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:42.675965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305260e-074c-4511-9d55-3d45bf798e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:42.676632 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305260e-074c-4511-9d55-3d45bf798e12 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:42.676913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305260e-074c-4511-9d55-3d45bf798e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:42.677191 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305260e-074c-4511-9d55-3d45bf798e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:42.677929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305260e-074c-4511-9d55-3d45bf798e12 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:42.678227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305260e-074c-4511-9d55-3d45bf798e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:42.679831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305260e-074c-4511-9d55-3d45bf798e12 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:42.689995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 639/1262] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:17:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:42.695938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25f46b-6b58-49db-a126-559404409745 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:42.706721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25f46b-6b58-49db-a126-559404409745 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:42.711586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478423d-72ca-4c94-b53d-f8bdb4d9d41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:42.712387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478423d-72ca-4c94-b53d-f8bdb4d9d41d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:42.712665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478423d-72ca-4c94-b53d-f8bdb4d9d41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:42.712932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478423d-72ca-4c94-b53d-f8bdb4d9d41d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:42.724086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478423d-72ca-4c94-b53d-f8bdb4d9d41d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:42.725930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478423d-72ca-4c94-b53d-f8bdb4d9d41d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:42.743581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-f478423d-72ca-4c94-b53d-f8bdb4d9d41d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:42.744837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 624/1263] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:42.751711 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305260e-074c-4511-9d55-3d45bf798e12 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:42.761639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305260e-074c-4511-9d55-3d45bf798e12 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:42.767155 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98e00e-ca5c-452f-b92a-8f6147d811a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:42.767795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98e00e-ca5c-452f-b92a-8f6147d811a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:42.768114 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98e00e-ca5c-452f-b92a-8f6147d811a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:42.768393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98e00e-ca5c-452f-b92a-8f6147d811a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:42.769150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98e00e-ca5c-452f-b92a-8f6147d811a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:42.769413 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98e00e-ca5c-452f-b92a-8f6147d811a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:42.771255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98e00e-ca5c-452f-b92a-8f6147d811a1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:42.783453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 640/1264] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:42.789118 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478423d-72ca-4c94-b53d-f8bdb4d9d41d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:42.799208 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478423d-72ca-4c94-b53d-f8bdb4d9d41d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:42.804797 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70e738-7df2-4f76-b5ef-453074ae0cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:42.805572 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70e738-7df2-4f76-b5ef-453074ae0cba admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:42.805894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70e738-7df2-4f76-b5ef-453074ae0cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:42.806195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70e738-7df2-4f76-b5ef-453074ae0cba admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:42.815645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70e738-7df2-4f76-b5ef-453074ae0cba admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:42.817715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70e738-7df2-4f76-b5ef-453074ae0cba admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:42.831862 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-fe70e738-7df2-4f76-b5ef-453074ae0cba admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 09:17:42.833071 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 625/1265] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:42.838913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98e00e-ca5c-452f-b92a-8f6147d811a1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:42.849128 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98e00e-ca5c-452f-b92a-8f6147d811a1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:42.853791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae85eba-573e-4bda-b1a2-df28dda22ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:42.854446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae85eba-573e-4bda-b1a2-df28dda22ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:42.854760 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae85eba-573e-4bda-b1a2-df28dda22ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:42.855010 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae85eba-573e-4bda-b1a2-df28dda22ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:42.855842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae85eba-573e-4bda-b1a2-df28dda22ad7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:42.856194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae85eba-573e-4bda-b1a2-df28dda22ad7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:42.858034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae85eba-573e-4bda-b1a2-df28dda22ad7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:42.877076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 641/1266] 10.222.0.90 () {56 vars in 1164 bytes} [Wed Feb 16 09:17:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:42.883357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70e738-7df2-4f76-b5ef-453074ae0cba admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:42.894218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70e738-7df2-4f76-b5ef-453074ae0cba admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:42.899110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd72e98-2269-4ec3-ad73-cefb6c939415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:42.899879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd72e98-2269-4ec3-ad73-cefb6c939415 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:42.900199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd72e98-2269-4ec3-ad73-cefb6c939415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:42.900472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd72e98-2269-4ec3-ad73-cefb6c939415 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:42.911899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd72e98-2269-4ec3-ad73-cefb6c939415 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:42.913776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd72e98-2269-4ec3-ad73-cefb6c939415 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:42.933326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-dbd72e98-2269-4ec3-ad73-cefb6c939415 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:42.934526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 626/1267] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:42.941284 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae85eba-573e-4bda-b1a2-df28dda22ad7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:42.950878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae85eba-573e-4bda-b1a2-df28dda22ad7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:42.956777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369866f-967a-45e2-904b-8665800cfb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:42.957415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369866f-967a-45e2-904b-8665800cfb53 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:42.957716 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369866f-967a-45e2-904b-8665800cfb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:42.957967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369866f-967a-45e2-904b-8665800cfb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:42.958687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369866f-967a-45e2-904b-8665800cfb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:42.958989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369866f-967a-45e2-904b-8665800cfb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:42.960603 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369866f-967a-45e2-904b-8665800cfb53 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:42.978021 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 642/1268] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:17:42.979266 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd72e98-2269-4ec3-ad73-cefb6c939415 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:42.990269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd72e98-2269-4ec3-ad73-cefb6c939415 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:42.995581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8ae77-66ca-45b4-be70-90073c0a8ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:42.996555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8ae77-66ca-45b4-be70-90073c0a8ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:42.996904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8ae77-66ca-45b4-be70-90073c0a8ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:42.997259 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8ae77-66ca-45b4-be70-90073c0a8ae9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:43.005635 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8ae77-66ca-45b4-be70-90073c0a8ae9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:43.007960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8ae77-66ca-45b4-be70-90073c0a8ae9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:43.026734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-6ec8ae77-66ca-45b4-be70-90073c0a8ae9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:17:43.028487 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 627/1269] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:17:43.035367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369866f-967a-45e2-904b-8665800cfb53 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:43.046212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369866f-967a-45e2-904b-8665800cfb53 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:43.051361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d2344-128b-48f0-be51-43d4c0f14064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:43.052106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d2344-128b-48f0-be51-43d4c0f14064 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:43.052393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d2344-128b-48f0-be51-43d4c0f14064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:43.052790 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d2344-128b-48f0-be51-43d4c0f14064 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:43.053671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d2344-128b-48f0-be51-43d4c0f14064 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:43.053995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d2344-128b-48f0-be51-43d4c0f14064 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:43.055869 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d2344-128b-48f0-be51-43d4c0f14064 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:43.074231 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 643/1270] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:43.075435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8ae77-66ca-45b4-be70-90073c0a8ae9 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:43.086317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8ae77-66ca-45b4-be70-90073c0a8ae9 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:43.090854 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4937dd-a34b-4dcd-9e5e-9e25ff1efce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:43.091720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4937dd-a34b-4dcd-9e5e-9e25ff1efce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:43.092010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4937dd-a34b-4dcd-9e5e-9e25ff1efce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:43.092315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4937dd-a34b-4dcd-9e5e-9e25ff1efce4 admin admin] PATH_INFO: `/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/7d870fbd90cb4fde9ceafd2b737795eb/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:43.095512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4937dd-a34b-4dcd-9e5e-9e25ff1efce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936ab51e6e2745658b252fbafdc2f8ef, user_id=7d870fbd90cb4fde9ceafd2b737795eb, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:43.098247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4937dd-a34b-4dcd-9e5e-9e25ff1efce4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:43.112552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 628/1271] 10.222.0.90 () {58 vars in 1460 bytes} [Wed Feb 16 09:17:43 2022] PUT /identity/v3/projects/936ab51e6e2745658b252fbafdc2f8ef/users/7d870fbd90cb4fde9ceafd2b737795eb/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:17:45.743853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaebda-02d9-46ef-83ce-48d7200e0373 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:45.744503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaebda-02d9-46ef-83ce-48d7200e0373 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:45.744503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceaebda-02d9-46ef-83ce-48d7200e0373 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:45.746225 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 644/1272] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:17:45.751773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae73d9c-af4c-42f3-9f5f-decadfd9fb39 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:45.752267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae73d9c-af4c-42f3-9f5f-decadfd9fb39 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:45.752467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae73d9c-af4c-42f3-9f5f-decadfd9fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:45.771900 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-7ae73d9c-af4c-42f3-9f5f-decadfd9fb39 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:17:45.773108 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-7ae73d9c-af4c-42f3-9f5f-decadfd9fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:17:45.831805 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 629/1273] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:17:45 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:17:45.856012 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaebda-02d9-46ef-83ce-48d7200e0373 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:45.868756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceaebda-02d9-46ef-83ce-48d7200e0373 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:45.873049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16807dd4-927b-4ee9-8c91-21b715778037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:45.873809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16807dd4-927b-4ee9-8c91-21b715778037 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:45.874133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16807dd4-927b-4ee9-8c91-21b715778037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:45.874700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16807dd4-927b-4ee9-8c91-21b715778037 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:45.884555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16807dd4-927b-4ee9-8c91-21b715778037 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 09:17:45.891600 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-16807dd4-927b-4ee9-8c91-21b715778037 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 09:17:45.892769 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 645/1274] 10.222.0.90 () {56 vars in 1117 bytes} [Wed Feb 16 09:17:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:45.898739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae73d9c-af4c-42f3-9f5f-decadfd9fb39 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:45.908444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae73d9c-af4c-42f3-9f5f-decadfd9fb39 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:45.912961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6285b6-d6f7-480c-909a-f4d482077be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:45.913607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6285b6-d6f7-480c-909a-f4d482077be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:45.913888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6285b6-d6f7-480c-909a-f4d482077be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:45.914164 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6285b6-d6f7-480c-909a-f4d482077be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:45.914897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6285b6-d6f7-480c-909a-f4d482077be3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:45.915202 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6285b6-d6f7-480c-909a-f4d482077be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:45.916828 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6285b6-d6f7-480c-909a-f4d482077be3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:45.925591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 630/1275] 10.222.0.90 () {56 vars in 1120 bytes} [Wed Feb 16 09:17:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:45.930733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16807dd4-927b-4ee9-8c91-21b715778037 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:45.940001 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16807dd4-927b-4ee9-8c91-21b715778037 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:45.944445 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c611878-4286-462c-9919-401d0f01cf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:45.945190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c611878-4286-462c-9919-401d0f01cf8a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:45.945464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c611878-4286-462c-9919-401d0f01cf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:45.945735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c611878-4286-462c-9919-401d0f01cf8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:45.956548 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c611878-4286-462c-9919-401d0f01cf8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:45.958342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c611878-4286-462c-9919-401d0f01cf8a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:45.974618 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-9c611878-4286-462c-9919-401d0f01cf8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:45.975711 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 646/1276] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:45.981079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6285b6-d6f7-480c-909a-f4d482077be3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:45.990412 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6285b6-d6f7-480c-909a-f4d482077be3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:45.994922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40dc0f-3c47-47b1-a7f3-1ab2b57be670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:45.995499 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40dc0f-3c47-47b1-a7f3-1ab2b57be670 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:45.995781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40dc0f-3c47-47b1-a7f3-1ab2b57be670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:45.996075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40dc0f-3c47-47b1-a7f3-1ab2b57be670 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:45.996772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40dc0f-3c47-47b1-a7f3-1ab2b57be670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:45.997073 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40dc0f-3c47-47b1-a7f3-1ab2b57be670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:45.998632 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40dc0f-3c47-47b1-a7f3-1ab2b57be670 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:46.010501 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 631/1277] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:46.016718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c611878-4286-462c-9919-401d0f01cf8a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:46.026420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c611878-4286-462c-9919-401d0f01cf8a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:46.031418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d8fb0-eaa5-4460-b346-763c0b950921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:46.032208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d8fb0-eaa5-4460-b346-763c0b950921 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:46.032486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d8fb0-eaa5-4460-b346-763c0b950921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:46.032752 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d8fb0-eaa5-4460-b346-763c0b950921 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:46.040504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d8fb0-eaa5-4460-b346-763c0b950921 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:46.042474 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d8fb0-eaa5-4460-b346-763c0b950921 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:46.055464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-da6d8fb0-eaa5-4460-b346-763c0b950921 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 09:17:46.056605 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 647/1278] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:17:46.062331 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40dc0f-3c47-47b1-a7f3-1ab2b57be670 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:46.071835 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40dc0f-3c47-47b1-a7f3-1ab2b57be670 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:46.076319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de500aae-32c0-4712-a60b-431565cccd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:46.076961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de500aae-32c0-4712-a60b-431565cccd06 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:46.077758 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de500aae-32c0-4712-a60b-431565cccd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:46.078026 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de500aae-32c0-4712-a60b-431565cccd06 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:46.078831 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de500aae-32c0-4712-a60b-431565cccd06 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:46.079131 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de500aae-32c0-4712-a60b-431565cccd06 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:46.080970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de500aae-32c0-4712-a60b-431565cccd06 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:46.098043 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 632/1279] 10.222.0.90 () {56 vars in 1164 bytes} [Wed Feb 16 09:17:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:46.103295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d8fb0-eaa5-4460-b346-763c0b950921 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:46.113235 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d8fb0-eaa5-4460-b346-763c0b950921 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:46.117630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7bc4-ca0d-4b05-83f3-93af743e4367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:46.118235 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7bc4-ca0d-4b05-83f3-93af743e4367 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:46.118509 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7bc4-ca0d-4b05-83f3-93af743e4367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:46.118775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad7bc4-ca0d-4b05-83f3-93af743e4367 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:46.127009 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad7bc4-ca0d-4b05-83f3-93af743e4367 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:46.128750 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad7bc4-ca0d-4b05-83f3-93af743e4367 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:46.137101 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 648/1280] 10.222.0.90 () {58 vars in 1324 bytes} [Wed Feb 16 09:17:46 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:17:46.142663 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de500aae-32c0-4712-a60b-431565cccd06 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:46.152239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de500aae-32c0-4712-a60b-431565cccd06 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:46.156783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9055cf1-76ea-457c-961b-cfe258e18317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:46.157541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9055cf1-76ea-457c-961b-cfe258e18317 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:46.157820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9055cf1-76ea-457c-961b-cfe258e18317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:46.158093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9055cf1-76ea-457c-961b-cfe258e18317 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:46.167900 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9055cf1-76ea-457c-961b-cfe258e18317 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:46.169727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9055cf1-76ea-457c-961b-cfe258e18317 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:46.186261 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-b9055cf1-76ea-457c-961b-cfe258e18317 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 09:17:46.187984 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 633/1281] 10.222.0.90 () {56 vars in 1129 bytes} [Wed Feb 16 09:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:17:46.193158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7bc4-ca0d-4b05-83f3-93af743e4367 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:46.201558 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad7bc4-ca0d-4b05-83f3-93af743e4367 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:46.206198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef5de2-d75c-404c-ba7e-2cf857a3bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:46.206816 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef5de2-d75c-404c-ba7e-2cf857a3bf75 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:46.207090 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef5de2-d75c-404c-ba7e-2cf857a3bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:46.207357 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef5de2-d75c-404c-ba7e-2cf857a3bf75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:46.208074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef5de2-d75c-404c-ba7e-2cf857a3bf75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:46.208375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef5de2-d75c-404c-ba7e-2cf857a3bf75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:46.209912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef5de2-d75c-404c-ba7e-2cf857a3bf75 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:46.221346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 649/1282] 10.222.0.90 () {56 vars in 1130 bytes} [Wed Feb 16 09:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:46.226308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9055cf1-76ea-457c-961b-cfe258e18317 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:46.236130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9055cf1-76ea-457c-961b-cfe258e18317 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:46.242117 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bb6ba-37fd-48d5-89d0-2a053a7f9c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:46.242873 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bb6ba-37fd-48d5-89d0-2a053a7f9c34 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:46.243153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bb6ba-37fd-48d5-89d0-2a053a7f9c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:46.243427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bb6ba-37fd-48d5-89d0-2a053a7f9c34 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:46.251353 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bb6ba-37fd-48d5-89d0-2a053a7f9c34 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:46.253297 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8bb6ba-37fd-48d5-89d0-2a053a7f9c34 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:46.266675 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING keystone.server.flask.application [None req-ad8bb6ba-37fd-48d5-89d0-2a053a7f9c34 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 09:17:46.267867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 634/1283] 10.222.0.90 () {56 vars in 1132 bytes} [Wed Feb 16 09:17:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 09:17:46.273947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef5de2-d75c-404c-ba7e-2cf857a3bf75 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:46.284068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef5de2-d75c-404c-ba7e-2cf857a3bf75 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:46.288518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1d9a6-d62f-4ffb-b275-1e994ec5bd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:46.289153 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1d9a6-d62f-4ffb-b275-1e994ec5bd44 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:46.289433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1d9a6-d62f-4ffb-b275-1e994ec5bd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:46.289705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1d9a6-d62f-4ffb-b275-1e994ec5bd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:46.290475 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1d9a6-d62f-4ffb-b275-1e994ec5bd44 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:46.290781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1d9a6-d62f-4ffb-b275-1e994ec5bd44 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:46.292630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1d9a6-d62f-4ffb-b275-1e994ec5bd44 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:46.303837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 650/1284] 10.222.0.90 () {56 vars in 1169 bytes} [Wed Feb 16 09:17:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:46.309404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bb6ba-37fd-48d5-89d0-2a053a7f9c34 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:46.320242 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bb6ba-37fd-48d5-89d0-2a053a7f9c34 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:46.324765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e2724-068d-4c52-9158-4cc10ba6c8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:46.325387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e2724-068d-4c52-9158-4cc10ba6c8db admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:46.325669 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e2724-068d-4c52-9158-4cc10ba6c8db admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:46.325945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e2724-068d-4c52-9158-4cc10ba6c8db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:46.326753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e2724-068d-4c52-9158-4cc10ba6c8db admin admin] RBAC: Adding query filter params (role.id=0e45946c6336419abb2015d8916e31ca, scope.project.id=936ab51e6e2745658b252fbafdc2f8ef, user.id=7d870fbd90cb4fde9ceafd2b737795eb) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:46.327059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e2724-068d-4c52-9158-4cc10ba6c8db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:46.329494 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e2724-068d-4c52-9158-4cc10ba6c8db admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:46.335069 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 635/1285] 10.222.0.90 () {56 vars in 1395 bytes} [Wed Feb 16 09:17:46 2022] GET /identity/v3/role_assignments?user.id=7d870fbd90cb4fde9ceafd2b737795eb&scope.project.id=936ab51e6e2745658b252fbafdc2f8ef&role.id=0e45946c6336419abb2015d8916e31ca => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:48.660745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fab17-6d0e-4c48-a26f-4dd6c3b75c50 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:48.661310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fab17-6d0e-4c48-a26f-4dd6c3b75c50 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:48.661310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fab17-6d0e-4c48-a26f-4dd6c3b75c50 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:48.663063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 651/1286] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:17:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:17:48.668315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b6f15-5152-4673-bbdf-c83d1aec5476 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:48.668716 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b6f15-5152-4673-bbdf-c83d1aec5476 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:48.668868 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b6f15-5152-4673-bbdf-c83d1aec5476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:48.686111 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-8b7b6f15-5152-4673-bbdf-c83d1aec5476 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:17:48.687779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8b7b6f15-5152-4673-bbdf-c83d1aec5476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:17:48.695498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 636/1287] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:17:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:17:48.718646 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fab17-6d0e-4c48-a26f-4dd6c3b75c50 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:48.730461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fab17-6d0e-4c48-a26f-4dd6c3b75c50 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:48.735312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703eb44-9d22-4bd3-84a9-d70680600e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:48.736096 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703eb44-9d22-4bd3-84a9-d70680600e55 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:48.736378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703eb44-9d22-4bd3-84a9-d70680600e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:48.736703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703eb44-9d22-4bd3-84a9-d70680600e55 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:48.737350 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703eb44-9d22-4bd3-84a9-d70680600e55 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:48.738923 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703eb44-9d22-4bd3-84a9-d70680600e55 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:48.750416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-8703eb44-9d22-4bd3-84a9-d70680600e55 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 16 09:17:48.751516 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 652/1288] 10.222.0.90 () {56 vars in 1138 bytes} [Wed Feb 16 09:17:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:48.756979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b6f15-5152-4673-bbdf-c83d1aec5476 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:48.766417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b6f15-5152-4673-bbdf-c83d1aec5476 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:48.771045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9760722-b683-43ce-8130-3b06d743fbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:48.771674 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9760722-b683-43ce-8130-3b06d743fbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:48.771957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9760722-b683-43ce-8130-3b06d743fbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:48.772257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9760722-b683-43ce-8130-3b06d743fbc3 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:48.772941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9760722-b683-43ce-8130-3b06d743fbc3 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:48.773239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9760722-b683-43ce-8130-3b06d743fbc3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:48.774785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9760722-b683-43ce-8130-3b06d743fbc3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:48.779393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 637/1289] 10.222.0.90 () {56 vars in 1137 bytes} [Wed Feb 16 09:17:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:48.785182 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703eb44-9d22-4bd3-84a9-d70680600e55 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:48.794454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703eb44-9d22-4bd3-84a9-d70680600e55 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:48.799482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60499233-0881-471a-8735-56699ed65e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:48.800133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60499233-0881-471a-8735-56699ed65e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:48.800415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60499233-0881-471a-8735-56699ed65e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:48.800690 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60499233-0881-471a-8735-56699ed65e34 admin admin] PATH_INFO: `/v3/services` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:48.801385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60499233-0881-471a-8735-56699ed65e34 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:48.801699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60499233-0881-471a-8735-56699ed65e34 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:48.803268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60499233-0881-471a-8735-56699ed65e34 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:48.807763 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 653/1290] 10.222.0.90 () {56 vars in 1137 bytes} [Wed Feb 16 09:17:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:51.115889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7e754-f97d-4be8-92d4-ef42013d9497 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:51.116471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7e754-f97d-4be8-92d4-ef42013d9497 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:51.116471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7e754-f97d-4be8-92d4-ef42013d9497 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:51.118227 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 638/1291] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:17:51.123429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3788a-56c8-4aaf-aaef-c47708da22b7 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:51.123942 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3788a-56c8-4aaf-aaef-c47708da22b7 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:51.124601 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3788a-56c8-4aaf-aaef-c47708da22b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:51.142734 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-50e3788a-56c8-4aaf-aaef-c47708da22b7 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:17:51.143908 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-50e3788a-56c8-4aaf-aaef-c47708da22b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:17:51.151664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 654/1292] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:17:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:17:51.175165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7e754-f97d-4be8-92d4-ef42013d9497 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:51.187929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7e754-f97d-4be8-92d4-ef42013d9497 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:51.192315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38540512-1106-4e36-9fb3-e760bc78664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:51.192947 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38540512-1106-4e36-9fb3-e760bc78664c admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:51.193231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38540512-1106-4e36-9fb3-e760bc78664c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:51.193504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38540512-1106-4e36-9fb3-e760bc78664c admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:51.194209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38540512-1106-4e36-9fb3-e760bc78664c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:51.195780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38540512-1106-4e36-9fb3-e760bc78664c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:51.208936 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 639/1293] 10.222.0.90 () {60 vars in 1162 bytes} [Wed Feb 16 09:17:51 2022] POST /identity/v3/services => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:17:53.539452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a175c-320e-4973-ba5a-24769a7624e0 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:53.539997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a175c-320e-4973-ba5a-24769a7624e0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:53.539997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a175c-320e-4973-ba5a-24769a7624e0 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:53.541774 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 655/1294] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:17:53.547027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777854c-4ad6-466e-94a5-226205d5fda8 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:53.547441 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777854c-4ad6-466e-94a5-226205d5fda8 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:53.547586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777854c-4ad6-466e-94a5-226205d5fda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:53.565692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-f777854c-4ad6-466e-94a5-226205d5fda8 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:17:53.566881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f777854c-4ad6-466e-94a5-226205d5fda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:17:53.583764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 640/1295] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:17:53 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:17:53.607179 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a175c-320e-4973-ba5a-24769a7624e0 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:53.619045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a175c-320e-4973-ba5a-24769a7624e0 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:53.623351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110d45-1e39-45e3-b9ae-cb03939f5713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:53.624275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110d45-1e39-45e3-b9ae-cb03939f5713 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:53.624748 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110d45-1e39-45e3-b9ae-cb03939f5713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:53.624846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6110d45-1e39-45e3-b9ae-cb03939f5713 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:53.625421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6110d45-1e39-45e3-b9ae-cb03939f5713 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:53.626984 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6110d45-1e39-45e3-b9ae-cb03939f5713 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:53.637539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-d6110d45-1e39-45e3-b9ae-cb03939f5713 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 16 09:17:53.638633 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 656/1296] 10.222.0.90 () {56 vars in 1138 bytes} [Wed Feb 16 09:17:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:53.645089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777854c-4ad6-466e-94a5-226205d5fda8 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:53.654135 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777854c-4ad6-466e-94a5-226205d5fda8 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:53.659362 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdf410-c418-4fc1-9e80-0e971172dde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:53.660052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdf410-c418-4fc1-9e80-0e971172dde1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:53.660346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdf410-c418-4fc1-9e80-0e971172dde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:53.660623 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdf410-c418-4fc1-9e80-0e971172dde1 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:53.661317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdf410-c418-4fc1-9e80-0e971172dde1 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:53.661619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdf410-c418-4fc1-9e80-0e971172dde1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:53.663190 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdf410-c418-4fc1-9e80-0e971172dde1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:53.668139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 641/1297] 10.222.0.90 () {56 vars in 1137 bytes} [Wed Feb 16 09:17:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:53.674322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110d45-1e39-45e3-b9ae-cb03939f5713 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:53.683611 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6110d45-1e39-45e3-b9ae-cb03939f5713 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:53.688844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc5373-3725-401f-8c67-d1d998d83476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:53.689460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc5373-3725-401f-8c67-d1d998d83476 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:53.689740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc5373-3725-401f-8c67-d1d998d83476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:53.690010 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc5373-3725-401f-8c67-d1d998d83476 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:53.690774 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc5373-3725-401f-8c67-d1d998d83476 admin admin] RBAC: Adding query filter params (interface=public, service_id=9e197eefcbe9444fa12bca54c7305523, region_id=RegionOne) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:53.691078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc5373-3725-401f-8c67-d1d998d83476 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:53.692671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc5373-3725-401f-8c67-d1d998d83476 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:53.697455 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 657/1298] 10.222.0.90 () {56 vars in 1272 bytes} [Wed Feb 16 09:17:53 2022] GET /identity/v3/endpoints?service_id=9e197eefcbe9444fa12bca54c7305523&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:53.703010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdf410-c418-4fc1-9e80-0e971172dde1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:53.712341 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdf410-c418-4fc1-9e80-0e971172dde1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:53.716843 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e58b7-afc7-41d6-b8c4-7642537c43d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:53.717468 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e58b7-afc7-41d6-b8c4-7642537c43d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:53.717780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e58b7-afc7-41d6-b8c4-7642537c43d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:53.718224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e58b7-afc7-41d6-b8c4-7642537c43d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:53.718885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e58b7-afc7-41d6-b8c4-7642537c43d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:53.720504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e58b7-afc7-41d6-b8c4-7642537c43d4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:53.727125 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 642/1299] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Feb 16 09:17:53 2022] GET /identity/v3/services => generated 2191 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:17:56.033931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986564d-52f9-492b-9418-ec22f8411b8b None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:56.034412 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986564d-52f9-492b-9418-ec22f8411b8b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:56.034501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986564d-52f9-492b-9418-ec22f8411b8b None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:56.036287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 658/1300] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:17:56.041373 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0fcd0-9435-4df7-a7b9-247f4b38dd9f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:56.041796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0fcd0-9435-4df7-a7b9-247f4b38dd9f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:56.041925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0fcd0-9435-4df7-a7b9-247f4b38dd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:56.059717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-eaf0fcd0-9435-4df7-a7b9-247f4b38dd9f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:17:56.060915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-eaf0fcd0-9435-4df7-a7b9-247f4b38dd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:17:56.069425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 643/1301] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:17:56 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:17:56.092526 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986564d-52f9-492b-9418-ec22f8411b8b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:56.104665 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986564d-52f9-492b-9418-ec22f8411b8b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:56.109555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a0331-d836-4e9f-aea4-1da65eb88b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:56.110311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a0331-d836-4e9f-aea4-1da65eb88b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:56.110591 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a0331-d836-4e9f-aea4-1da65eb88b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:56.110859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a0331-d836-4e9f-aea4-1da65eb88b36 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:56.111495 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a0331-d836-4e9f-aea4-1da65eb88b36 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:56.113089 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a0331-d836-4e9f-aea4-1da65eb88b36 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:56.123717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING keystone.server.flask.application [None req-947a0331-d836-4e9f-aea4-1da65eb88b36 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 16 09:17:56.125591 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 659/1302] 10.222.0.90 () {56 vars in 1138 bytes} [Wed Feb 16 09:17:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 09:17:56.131157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0fcd0-9435-4df7-a7b9-247f4b38dd9f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:56.140800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0fcd0-9435-4df7-a7b9-247f4b38dd9f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:56.145388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d0668-f0e0-4b78-b479-ffb4a1e9e30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:56.146282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0668-f0e0-4b78-b479-ffb4a1e9e30a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:56.146562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0668-f0e0-4b78-b479-ffb4a1e9e30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:56.146838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d0668-f0e0-4b78-b479-ffb4a1e9e30a admin admin] PATH_INFO: `/v3/services` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:56.147530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d0668-f0e0-4b78-b479-ffb4a1e9e30a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:17:56.147831 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d0668-f0e0-4b78-b479-ffb4a1e9e30a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:56.149450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d0668-f0e0-4b78-b479-ffb4a1e9e30a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:56.154528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 644/1303] 10.222.0.90 () {56 vars in 1137 bytes} [Wed Feb 16 09:17:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:17:56.159575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a0331-d836-4e9f-aea4-1da65eb88b36 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:17:56.169274 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a0331-d836-4e9f-aea4-1da65eb88b36 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:17:56.173804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcfe28-5d83-485a-aa59-9ef3f17333b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:17:56.174409 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcfe28-5d83-485a-aa59-9ef3f17333b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:17:56.174690 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcfe28-5d83-485a-aa59-9ef3f17333b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:17:56.174963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcfe28-5d83-485a-aa59-9ef3f17333b2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:17:56.175684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcfe28-5d83-485a-aa59-9ef3f17333b2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:17:56.177253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcfe28-5d83-485a-aa59-9ef3f17333b2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:17:56.196167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 660/1304] 10.222.0.90 () {60 vars in 1165 bytes} [Wed Feb 16 09:17:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:19:00.062778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbac95-4a2c-4be3-bcf9-04a881dc3e70 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:00.063719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbac95-4a2c-4be3-bcf9-04a881dc3e70 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:00.064185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbac95-4a2c-4be3-bcf9-04a881dc3e70 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:00.071378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa31a5c-8863-4d22-965b-70ce1f3c1e47 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:00.072218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa31a5c-8863-4d22-965b-70ce1f3c1e47 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:00.072647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa31a5c-8863-4d22-965b-70ce1f3c1e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:00.076201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 645/1305] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:00.165645 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2fa31a5c-8863-4d22-965b-70ce1f3c1e47 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:00.167126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2fa31a5c-8863-4d22-965b-70ce1f3c1e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:00.292610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 661/1306] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:19:00.304889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbac95-4a2c-4be3-bcf9-04a881dc3e70 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:00.306905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f1bbac95-4a2c-4be3-bcf9-04a881dc3e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:00.575055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbac95-4a2c-4be3-bcf9-04a881dc3e70 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:00.680568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83edc95-83c0-4153-aa8f-4c76e6d58d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:00.681229 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83edc95-83c0-4153-aa8f-4c76e6d58d9a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:00.681509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83edc95-83c0-4153-aa8f-4c76e6d58d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:00.681781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83edc95-83c0-4153-aa8f-4c76e6d58d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:00.682497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83edc95-83c0-4153-aa8f-4c76e6d58d9a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:00.684407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83edc95-83c0-4153-aa8f-4c76e6d58d9a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:00.708057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 646/1307] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Feb 16 09:19:00 2022] GET /identity/v3/projects => generated 2553 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:19:03.070835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcef98-d0cb-4a59-9852-f0a5c10fee6d None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:03.071382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcef98-d0cb-4a59-9852-f0a5c10fee6d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:03.071382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcef98-d0cb-4a59-9852-f0a5c10fee6d None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:03.073265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 662/1308] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:03.078698 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a522c-7ef6-4ae5-9376-0e6f80d4bde8 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:03.079157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a522c-7ef6-4ae5-9376-0e6f80d4bde8 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:03.079248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a522c-7ef6-4ae5-9376-0e6f80d4bde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:03.148123 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-221a522c-7ef6-4ae5-9376-0e6f80d4bde8 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:03.149558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-221a522c-7ef6-4ae5-9376-0e6f80d4bde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:03.244105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 647/1309] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:03.298580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1e5d8-ece7-4f60-a8c3-9a366ca3b178 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:03.298872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1e5d8-ece7-4f60-a8c3-9a366ca3b178 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:03.299150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1e5d8-ece7-4f60-a8c3-9a366ca3b178 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:03.300997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 663/1310] 10.222.0.90 () {54 vars in 964 bytes} [Wed Feb 16 09:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:03.307439 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bff299-a0f1-4170-ac56-554f7f599c7d None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:03.307732 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bff299-a0f1-4170-ac56-554f7f599c7d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:03.308001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bff299-a0f1-4170-ac56-554f7f599c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:03.385682 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-65bff299-a0f1-4170-ac56-554f7f599c7d None None] MFA Rules not processed for user `39d5d18c09054343b4e000950ba875fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:03.386889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-65bff299-a0f1-4170-ac56-554f7f599c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:03.474790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 648/1311] 10.222.0.90 () {58 vars in 1061 bytes} [Wed Feb 16 09:19:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:03.486696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1e5d8-ece7-4f60-a8c3-9a366ca3b178 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:03.489246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-abc1e5d8-ece7-4f60-a8c3-9a366ca3b178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:03.602722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1e5d8-ece7-4f60-a8c3-9a366ca3b178 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:03.673783 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4a387-0beb-480e-8252-36b80529ad85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:03.674443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4a387-0beb-480e-8252-36b80529ad85 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:03.674728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4a387-0beb-480e-8252-36b80529ad85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:03.675001 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4a387-0beb-480e-8252-36b80529ad85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:03.676676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cca4a387-0beb-480e-8252-36b80529ad85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:03.783892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4a387-0beb-480e-8252-36b80529ad85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:03.785268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4a387-0beb-480e-8252-36b80529ad85 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:03.802485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 664/1312] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:19:06.413233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c32f1b-1ece-4db3-9274-fbd4fa3162f2 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:06.413780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c32f1b-1ece-4db3-9274-fbd4fa3162f2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:06.413780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c32f1b-1ece-4db3-9274-fbd4fa3162f2 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:06.415567 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 649/1313] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:06.420726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb5b14-69fa-421c-8d57-52d449979447 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:06.421790 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb5b14-69fa-421c-8d57-52d449979447 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:06.422130 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb5b14-69fa-421c-8d57-52d449979447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:06.485952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a6eb5b14-69fa-421c-8d57-52d449979447 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:06.487260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a6eb5b14-69fa-421c-8d57-52d449979447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:06.596980 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 665/1314] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:06.638344 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c32f1b-1ece-4db3-9274-fbd4fa3162f2 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:06.639906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a6c32f1b-1ece-4db3-9274-fbd4fa3162f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:06.749217 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c32f1b-1ece-4db3-9274-fbd4fa3162f2 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:06.820981 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bb5cf-23ce-4068-b0d6-6d8bff480901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:06.821915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bb5cf-23ce-4068-b0d6-6d8bff480901 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:06.822194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bb5cf-23ce-4068-b0d6-6d8bff480901 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:06.822463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bb5cf-23ce-4068-b0d6-6d8bff480901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:06.824135 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-7e1bb5cf-23ce-4068-b0d6-6d8bff480901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:06.930249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bb5cf-23ce-4068-b0d6-6d8bff480901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:06.931700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bb5cf-23ce-4068-b0d6-6d8bff480901 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:06.949722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 650/1315] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:19:09.572193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b26d0e-3526-4c90-b278-8e6100166344 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:09.572739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b26d0e-3526-4c90-b278-8e6100166344 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:09.572739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b26d0e-3526-4c90-b278-8e6100166344 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:09.574579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 666/1316] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:09.579806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d79bd-6306-42db-aa36-3e5434041b63 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:09.580280 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d79bd-6306-42db-aa36-3e5434041b63 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:09.580398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d79bd-6306-42db-aa36-3e5434041b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:09.644777 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-ef6d79bd-6306-42db-aa36-3e5434041b63 None None] MFA Rules not processed for user `01ad08141b814f0891a90f77ff968374`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:09.645979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ef6d79bd-6306-42db-aa36-3e5434041b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:09.746381 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 651/1317] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:09.786925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b26d0e-3526-4c90-b278-8e6100166344 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:09.788504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-30b26d0e-3526-4c90-b278-8e6100166344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:09.888517 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b26d0e-3526-4c90-b278-8e6100166344 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:09.959354 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a84ce8-fc7e-4820-974f-df6591d735fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:09.959989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a84ce8-fc7e-4820-974f-df6591d735fe service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:09.960295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a84ce8-fc7e-4820-974f-df6591d735fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:09.960566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a84ce8-fc7e-4820-974f-df6591d735fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:09.962185 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d6a84ce8-fc7e-4820-974f-df6591d735fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:10.067944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a84ce8-fc7e-4820-974f-df6591d735fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:10.069404 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a84ce8-fc7e-4820-974f-df6591d735fe service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:10.086381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 667/1318] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:19:12.955187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886093dc-39aa-4711-ab74-79347c07aeef None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:12.955736 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886093dc-39aa-4711-ab74-79347c07aeef None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:12.955736 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886093dc-39aa-4711-ab74-79347c07aeef None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:12.957547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 652/1319] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:12.962854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8debce6-1ac6-48c1-8240-d9bfacf2eb91 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:12.963302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8debce6-1ac6-48c1-8240-d9bfacf2eb91 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:12.963395 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8debce6-1ac6-48c1-8240-d9bfacf2eb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:13.027595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e8debce6-1ac6-48c1-8240-d9bfacf2eb91 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:13.028808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e8debce6-1ac6-48c1-8240-d9bfacf2eb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:13.128965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 668/1320] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:13.174432 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886093dc-39aa-4711-ab74-79347c07aeef None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:13.176008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-886093dc-39aa-4711-ab74-79347c07aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:13.273848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886093dc-39aa-4711-ab74-79347c07aeef None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:13.343820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07372d51-6ab0-4d92-9fdb-d75627340d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:13.344483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07372d51-6ab0-4d92-9fdb-d75627340d00 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:13.344765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07372d51-6ab0-4d92-9fdb-d75627340d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:13.345040 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07372d51-6ab0-4d92-9fdb-d75627340d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:13.346662 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-07372d51-6ab0-4d92-9fdb-d75627340d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:13.449355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07372d51-6ab0-4d92-9fdb-d75627340d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:13.450788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07372d51-6ab0-4d92-9fdb-d75627340d00 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:13.468975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 653/1321] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:19:16.540198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c1e7d-c4c0-4568-b6ca-73024c97f8e7 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:16.540745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c1e7d-c4c0-4568-b6ca-73024c97f8e7 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:16.540745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c1e7d-c4c0-4568-b6ca-73024c97f8e7 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:16.542543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 669/1322] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:16.548541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dfe2d-c55f-4fac-b583-34ede3b45c5f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:16.548973 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dfe2d-c55f-4fac-b583-34ede3b45c5f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:16.549223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dfe2d-c55f-4fac-b583-34ede3b45c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:16.614782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-314dfe2d-c55f-4fac-b583-34ede3b45c5f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:16.616007 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-314dfe2d-c55f-4fac-b583-34ede3b45c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:16.711409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 654/1323] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:16.747929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c1e7d-c4c0-4568-b6ca-73024c97f8e7 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:16.749625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-646c1e7d-c4c0-4568-b6ca-73024c97f8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:16.852575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c1e7d-c4c0-4568-b6ca-73024c97f8e7 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:16.925386 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db79ea-de04-4a46-8022-fe627063ce84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:16.926050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db79ea-de04-4a46-8022-fe627063ce84 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:16.926331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db79ea-de04-4a46-8022-fe627063ce84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:16.926601 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db79ea-de04-4a46-8022-fe627063ce84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:16.928287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b6db79ea-de04-4a46-8022-fe627063ce84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:17.039198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db79ea-de04-4a46-8022-fe627063ce84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:17.040706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db79ea-de04-4a46-8022-fe627063ce84 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:17.058969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 670/1324] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:19:19.435558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7e270-91c3-4dc3-87a3-90d7a4d5e7b5 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:19.436171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7e270-91c3-4dc3-87a3-90d7a4d5e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:19.436171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7e270-91c3-4dc3-87a3-90d7a4d5e7b5 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:19.438515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 655/1325] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:19.443840 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8881-e45a-40e6-ba3b-4810f5afdb3f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:19.444302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8881-e45a-40e6-ba3b-4810f5afdb3f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:19.444497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8881-e45a-40e6-ba3b-4810f5afdb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:19.508865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a1ec8881-e45a-40e6-ba3b-4810f5afdb3f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:19.510057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a1ec8881-e45a-40e6-ba3b-4810f5afdb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:19.606288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 671/1326] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:19:19.644728 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7e270-91c3-4dc3-87a3-90d7a4d5e7b5 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:19.646333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-24b7e270-91c3-4dc3-87a3-90d7a4d5e7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:19.744874 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7e270-91c3-4dc3-87a3-90d7a4d5e7b5 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:19.816236 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351903d-ce43-426c-a712-c1d9549f8b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:19.816890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351903d-ce43-426c-a712-c1d9549f8b3c service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:19.817167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351903d-ce43-426c-a712-c1d9549f8b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:19.817434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351903d-ce43-426c-a712-c1d9549f8b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:19.819227 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-5351903d-ce43-426c-a712-c1d9549f8b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:19.926319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351903d-ce43-426c-a712-c1d9549f8b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:19.927771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351903d-ce43-426c-a712-c1d9549f8b3c service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:19.946416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 656/1327] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:19:22.336613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66d5d5-a2a3-4f72-8715-e2bafa36985d None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:22.337148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66d5d5-a2a3-4f72-8715-e2bafa36985d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:22.337148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66d5d5-a2a3-4f72-8715-e2bafa36985d None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:22.338957 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 672/1328] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:22.344390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8187-1a34-4fe6-829f-5c6c7611815c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:22.344814 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8187-1a34-4fe6-829f-5c6c7611815c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:22.344948 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef8187-1a34-4fe6-829f-5c6c7611815c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:22.412797 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-c2ef8187-1a34-4fe6-829f-5c6c7611815c None None] MFA Rules not processed for user `01ad08141b814f0891a90f77ff968374`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:22.414005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c2ef8187-1a34-4fe6-829f-5c6c7611815c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:22.508198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 657/1329] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:22.546510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66d5d5-a2a3-4f72-8715-e2bafa36985d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:22.548257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ee66d5d5-a2a3-4f72-8715-e2bafa36985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:22.650330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66d5d5-a2a3-4f72-8715-e2bafa36985d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:22.722574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52fa64-21ab-4a9b-ac98-356bb1fe3341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:22.723221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52fa64-21ab-4a9b-ac98-356bb1fe3341 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:22.723502 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52fa64-21ab-4a9b-ac98-356bb1fe3341 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:22.723779 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52fa64-21ab-4a9b-ac98-356bb1fe3341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:22.725432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5b52fa64-21ab-4a9b-ac98-356bb1fe3341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:22.831894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52fa64-21ab-4a9b-ac98-356bb1fe3341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:22.833359 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52fa64-21ab-4a9b-ac98-356bb1fe3341 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:22.850698 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 673/1330] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:19:25.516710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cf596-064a-4177-a979-f9e79eef30e7 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:25.517394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cf596-064a-4177-a979-f9e79eef30e7 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:25.517394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cf596-064a-4177-a979-f9e79eef30e7 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:25.519087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 658/1331] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:25.525104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9211a4-07d7-4c68-ae72-55f7d44cc37c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:25.525561 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9211a4-07d7-4c68-ae72-55f7d44cc37c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:25.525650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9211a4-07d7-4c68-ae72-55f7d44cc37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:25.592914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4a9211a4-07d7-4c68-ae72-55f7d44cc37c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:25.594970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4a9211a4-07d7-4c68-ae72-55f7d44cc37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:25.699076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 674/1332] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:25.747559 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cf596-064a-4177-a979-f9e79eef30e7 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:25.749175 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-b19cf596-064a-4177-a979-f9e79eef30e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:25.860364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cf596-064a-4177-a979-f9e79eef30e7 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:25.941210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb958e13-49d2-4edf-b819-b1711e808256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:25.941862 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958e13-49d2-4edf-b819-b1711e808256 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:25.942146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958e13-49d2-4edf-b819-b1711e808256 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:25.942422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958e13-49d2-4edf-b819-b1711e808256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:25.944640 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-bb958e13-49d2-4edf-b819-b1711e808256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:26.072501 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb958e13-49d2-4edf-b819-b1711e808256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:26.073974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb958e13-49d2-4edf-b819-b1711e808256 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:26.095423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 659/1333] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:19:28.531826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e129b-6601-4b03-883e-d95935bc52e5 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:28.532394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e129b-6601-4b03-883e-d95935bc52e5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:28.532394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e129b-6601-4b03-883e-d95935bc52e5 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:28.534185 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 675/1334] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:28.539601 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21354c-170d-4607-96b5-0b094ccd232c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:28.540000 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21354c-170d-4607-96b5-0b094ccd232c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:28.540248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21354c-170d-4607-96b5-0b094ccd232c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:28.602898 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0b21354c-170d-4607-96b5-0b094ccd232c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:28.604107 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0b21354c-170d-4607-96b5-0b094ccd232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:28.703812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 660/1335] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:28.745265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e129b-6601-4b03-883e-d95935bc52e5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:28.746797 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-dc0e129b-6601-4b03-883e-d95935bc52e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:28.846867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e129b-6601-4b03-883e-d95935bc52e5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:28.917154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c4b3e-7b32-48d7-99a3-5360c5574e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:28.917784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c4b3e-7b32-48d7-99a3-5360c5574e5f service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:28.918062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c4b3e-7b32-48d7-99a3-5360c5574e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:28.918332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c4b3e-7b32-48d7-99a3-5360c5574e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:28.919934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-475c4b3e-7b32-48d7-99a3-5360c5574e5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:29.029910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c4b3e-7b32-48d7-99a3-5360c5574e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:29.032568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c4b3e-7b32-48d7-99a3-5360c5574e5f service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:29.050549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 676/1336] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:19:31.676836 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6103f-5135-45c8-b021-377ba4a5da2d None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:31.677417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6103f-5135-45c8-b021-377ba4a5da2d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:31.677417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6103f-5135-45c8-b021-377ba4a5da2d None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:31.679192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 661/1337] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:31.684596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034d21a-5984-4562-aafb-1a2cb6dfcf19 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:31.685001 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034d21a-5984-4562-aafb-1a2cb6dfcf19 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:31.685153 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034d21a-5984-4562-aafb-1a2cb6dfcf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:31.754937 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5034d21a-5984-4562-aafb-1a2cb6dfcf19 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:31.756207 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5034d21a-5984-4562-aafb-1a2cb6dfcf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:31.861269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 677/1338] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:31.910966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507277d-1261-40dd-a8b5-bdc9e0b1f037 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:31.911246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507277d-1261-40dd-a8b5-bdc9e0b1f037 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:31.911545 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507277d-1261-40dd-a8b5-bdc9e0b1f037 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:31.913335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 662/1339] 10.222.0.90 () {54 vars in 964 bytes} [Wed Feb 16 09:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:31.919120 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb62f3-c45c-4d2f-a5d1-482160608547 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:31.919412 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb62f3-c45c-4d2f-a5d1-482160608547 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:31.919689 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb62f3-c45c-4d2f-a5d1-482160608547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:31.986579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-68cb62f3-c45c-4d2f-a5d1-482160608547 None None] MFA Rules not processed for user `39d5d18c09054343b4e000950ba875fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:31.987687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-68cb62f3-c45c-4d2f-a5d1-482160608547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:32.062042 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 678/1340] 10.222.0.90 () {58 vars in 1061 bytes} [Wed Feb 16 09:19:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:32.071506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507277d-1261-40dd-a8b5-bdc9e0b1f037 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:32.083657 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507277d-1261-40dd-a8b5-bdc9e0b1f037 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:32.087167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9cb21-9b61-4ba4-996c-ad601414fb9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:32.087791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9cb21-9b61-4ba4-996c-ad601414fb9e service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:32.088102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9cb21-9b61-4ba4-996c-ad601414fb9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:32.088383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9cb21-9b61-4ba4-996c-ad601414fb9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:32.097202 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9cb21-9b61-4ba4-996c-ad601414fb9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:32.098622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9cb21-9b61-4ba4-996c-ad601414fb9e service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:32.107707 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 663/1341] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:19:36.954858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16c846-a5ee-4b28-b750-fcf143543c7b None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:36.955418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16c846-a5ee-4b28-b750-fcf143543c7b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:36.955418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16c846-a5ee-4b28-b750-fcf143543c7b None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:36.957365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 679/1342] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:36.962467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442fde1-4e57-429f-85cd-2e97e9ec4de7 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:36.962906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442fde1-4e57-429f-85cd-2e97e9ec4de7 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:36.963002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442fde1-4e57-429f-85cd-2e97e9ec4de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:36.991741 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-1442fde1-4e57-429f-85cd-2e97e9ec4de7 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:36.992982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1442fde1-4e57-429f-85cd-2e97e9ec4de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:37.071242 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 664/1343] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:37.110906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16c846-a5ee-4b28-b750-fcf143543c7b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:37.121437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16c846-a5ee-4b28-b750-fcf143543c7b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:37.125107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c46a7-87ba-48dc-8924-d638e9e62c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:37.125735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c46a7-87ba-48dc-8924-d638e9e62c85 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:37.126014 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c46a7-87ba-48dc-8924-d638e9e62c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:37.126287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c46a7-87ba-48dc-8924-d638e9e62c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:37.135505 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c46a7-87ba-48dc-8924-d638e9e62c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:37.136984 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c46a7-87ba-48dc-8924-d638e9e62c85 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:37.147049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 680/1344] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:19:40.122746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51b91-1f50-47a2-b4dd-fd9b3075c508 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:40.123267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51b91-1f50-47a2-b4dd-fd9b3075c508 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:40.123267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a51b91-1f50-47a2-b4dd-fd9b3075c508 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:40.125067 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 665/1345] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:40.130429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed7959-f813-47be-8a16-78d715c591ed None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:40.130840 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed7959-f813-47be-8a16-78d715c591ed None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:40.131163 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed7959-f813-47be-8a16-78d715c591ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:40.149539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e5ed7959-f813-47be-8a16-78d715c591ed None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:40.150996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e5ed7959-f813-47be-8a16-78d715c591ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:40.159462 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 681/1346] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:40.205557 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a51b91-1f50-47a2-b4dd-fd9b3075c508 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:40.216530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a51b91-1f50-47a2-b4dd-fd9b3075c508 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:40.220736 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a516bd-1453-4433-8623-8684fe67fe33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:40.221357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a516bd-1453-4433-8623-8684fe67fe33 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:40.221639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a516bd-1453-4433-8623-8684fe67fe33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:40.221906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a516bd-1453-4433-8623-8684fe67fe33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:40.230463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a516bd-1453-4433-8623-8684fe67fe33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:40.231880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a516bd-1453-4433-8623-8684fe67fe33 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:40.240947 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 666/1347] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:19:44.592319 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f89db-197e-4d15-ac8b-76bff73a28ed None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:44.592848 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f89db-197e-4d15-ac8b-76bff73a28ed None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:44.592951 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f89db-197e-4d15-ac8b-76bff73a28ed None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:44.595444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 682/1348] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:44.600990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d3d96-98b3-4a19-87c6-c4cc5c1da874 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:44.601436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d3d96-98b3-4a19-87c6-c4cc5c1da874 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:44.601534 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d3d96-98b3-4a19-87c6-c4cc5c1da874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:44.619485 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-ff6d3d96-98b3-4a19-87c6-c4cc5c1da874 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:44.620591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ff6d3d96-98b3-4a19-87c6-c4cc5c1da874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:44.629382 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 667/1349] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:44.667720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f89db-197e-4d15-ac8b-76bff73a28ed None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:19:44.678356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f89db-197e-4d15-ac8b-76bff73a28ed None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:19:44.681863 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17e062-950b-4847-aefe-9b591c7342bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:19:44.682488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17e062-950b-4847-aefe-9b591c7342bc service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:44.682771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17e062-950b-4847-aefe-9b591c7342bc service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:44.683048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17e062-950b-4847-aefe-9b591c7342bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:44.691934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17e062-950b-4847-aefe-9b591c7342bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:19:44.693394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17e062-950b-4847-aefe-9b591c7342bc service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:19:44.703493 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 683/1350] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:19:50.056136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52d411-abaa-4b62-ad9a-c06562276c0b None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:50.057169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52d411-abaa-4b62-ad9a-c06562276c0b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:50.057666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52d411-abaa-4b62-ad9a-c06562276c0b None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:50.060099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 668/1351] 10.222.0.90 () {54 vars in 921 bytes} [Wed Feb 16 09:19:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:50.066703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde370-e443-44d2-8c69-929bd1f4cf6b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:50.067180 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde370-e443-44d2-8c69-929bd1f4cf6b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:50.067268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fde370-e443-44d2-8c69-929bd1f4cf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:50.128704 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d1fde370-e443-44d2-8c69-929bd1f4cf6b None None] MFA Rules not processed for user `7d870fbd90cb4fde9ceafd2b737795eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:50.130230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d1fde370-e443-44d2-8c69-929bd1f4cf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:50.235670 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 684/1352] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Feb 16 09:19:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:54.588451 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fd3e9-7131-464b-b12d-85fe45046aad None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:54.589142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fd3e9-7131-464b-b12d-85fe45046aad None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:54.589287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fd3e9-7131-464b-b12d-85fe45046aad None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:54.591203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 669/1353] 10.222.0.90 () {54 vars in 921 bytes} [Wed Feb 16 09:19:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:54.597791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cf000-d871-44b4-8fe8-52f54dd911c9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:54.598459 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cf000-d871-44b4-8fe8-52f54dd911c9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:54.598576 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cf000-d871-44b4-8fe8-52f54dd911c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:54.622345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9b3cf000-d871-44b4-8fe8-52f54dd911c9 None None] MFA Rules not processed for user `7d870fbd90cb4fde9ceafd2b737795eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:54.623910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9b3cf000-d871-44b4-8fe8-52f54dd911c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:54.634889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 685/1354] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Feb 16 09:19:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:19:56.404236 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235c2d4-87df-4150-9c0d-e397f251c146 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:56.404772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235c2d4-87df-4150-9c0d-e397f251c146 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:56.404772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235c2d4-87df-4150-9c0d-e397f251c146 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:56.406670 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 670/1355] 10.222.0.90 () {54 vars in 921 bytes} [Wed Feb 16 09:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:19:56.412258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62ec35-e9f5-4904-b171-c1bb01cfeee3 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:19:56.412775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62ec35-e9f5-4904-b171-c1bb01cfeee3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:19:56.412907 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62ec35-e9f5-4904-b171-c1bb01cfeee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:19:56.433895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-cc62ec35-e9f5-4904-b171-c1bb01cfeee3 None None] MFA Rules not processed for user `7d870fbd90cb4fde9ceafd2b737795eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:19:56.435104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cc62ec35-e9f5-4904-b171-c1bb01cfeee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:19:56.444665 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 686/1356] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Feb 16 09:19:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:20:00.247601 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef5f7a-0f68-4f96-8250-a56cda6e7c07 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:00.248418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef5f7a-0f68-4f96-8250-a56cda6e7c07 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:00.248418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef5f7a-0f68-4f96-8250-a56cda6e7c07 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:00.249954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 671/1357] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:00.255819 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3d440-3750-4bfa-bae6-58ff87be8aae None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:00.256504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3d440-3750-4bfa-bae6-58ff87be8aae None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:00.256912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3d440-3750-4bfa-bae6-58ff87be8aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:00.278150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d4e3d440-3750-4bfa-bae6-58ff87be8aae None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:00.279369 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d4e3d440-3750-4bfa-bae6-58ff87be8aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:00.288148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 687/1358] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:00.340801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1400b4-91b2-470d-b241-97a79d853915 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:00.341101 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1400b4-91b2-470d-b241-97a79d853915 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:00.341383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1400b4-91b2-470d-b241-97a79d853915 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:00.343371 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 672/1359] 10.222.0.90 () {54 vars in 961 bytes} [Wed Feb 16 09:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:00.349540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df89b3-46fe-42a0-bb79-fd13833998c6 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:00.350047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df89b3-46fe-42a0-bb79-fd13833998c6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:00.350327 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df89b3-46fe-42a0-bb79-fd13833998c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:00.401023 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b5df89b3-46fe-42a0-bb79-fd13833998c6 None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:00.402459 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b5df89b3-46fe-42a0-bb79-fd13833998c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:00.484624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 688/1360] 10.222.0.90 () {58 vars in 1058 bytes} [Wed Feb 16 09:20:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:00.493276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1400b4-91b2-470d-b241-97a79d853915 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:00.508554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1400b4-91b2-470d-b241-97a79d853915 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:00.515156 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb367c-a006-4e12-9c76-142e915703b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:00.516655 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb367c-a006-4e12-9c76-142e915703b5 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:00.517370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb367c-a006-4e12-9c76-142e915703b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:00.517867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb367c-a006-4e12-9c76-142e915703b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:00.527804 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb367c-a006-4e12-9c76-142e915703b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:00.529482 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb367c-a006-4e12-9c76-142e915703b5 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:00.540313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 673/1361] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:03.215800 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72635ae1-f998-4930-9236-2d03421e71e5 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:03.216368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72635ae1-f998-4930-9236-2d03421e71e5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:03.216368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72635ae1-f998-4930-9236-2d03421e71e5 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:03.218142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 689/1362] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:03.225374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06258f95-072a-459f-8d45-8971257476ef None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:03.225886 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06258f95-072a-459f-8d45-8971257476ef None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:03.225977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06258f95-072a-459f-8d45-8971257476ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:03.248701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-06258f95-072a-459f-8d45-8971257476ef None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:03.251033 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-06258f95-072a-459f-8d45-8971257476ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:03.262937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 674/1363] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:03.323075 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72635ae1-f998-4930-9236-2d03421e71e5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:03.338506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72635ae1-f998-4930-9236-2d03421e71e5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:03.345093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa328c-c1ee-40c1-be83-50e6ee5901a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:03.345723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa328c-c1ee-40c1-be83-50e6ee5901a7 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:03.346000 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa328c-c1ee-40c1-be83-50e6ee5901a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:03.346269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa328c-c1ee-40c1-be83-50e6ee5901a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:03.354746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa328c-c1ee-40c1-be83-50e6ee5901a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:03.356365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa328c-c1ee-40c1-be83-50e6ee5901a7 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:03.367726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 690/1364] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:06.089851 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab0bf7-ac3b-4490-877e-70209bcf9b15 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:06.090770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab0bf7-ac3b-4490-877e-70209bcf9b15 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:06.091291 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab0bf7-ac3b-4490-877e-70209bcf9b15 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:06.093569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 675/1365] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:06.099196 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3f24d-c633-419f-a293-d1b60cc0fb20 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:06.099675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3f24d-c633-419f-a293-d1b60cc0fb20 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:06.099783 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3f24d-c633-419f-a293-d1b60cc0fb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:06.122542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c7e3f24d-c633-419f-a293-d1b60cc0fb20 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:06.123757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c7e3f24d-c633-419f-a293-d1b60cc0fb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:06.132530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 691/1366] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:06.182551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb522-f497-42d5-9cbb-3994d88f81b2 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:06.182950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb522-f497-42d5-9cbb-3994d88f81b2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:06.183287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fb522-f497-42d5-9cbb-3994d88f81b2 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:06.189356 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 676/1367] 10.222.0.90 () {54 vars in 961 bytes} [Wed Feb 16 09:20:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:06.197183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12502bf-ef0b-4048-9642-7ce811940e9d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:06.197472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12502bf-ef0b-4048-9642-7ce811940e9d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:06.197746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12502bf-ef0b-4048-9642-7ce811940e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:06.225865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e12502bf-ef0b-4048-9642-7ce811940e9d None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:06.227435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e12502bf-ef0b-4048-9642-7ce811940e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:06.246586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 692/1368] 10.222.0.90 () {58 vars in 1058 bytes} [Wed Feb 16 09:20:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:06.247435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fb522-f497-42d5-9cbb-3994d88f81b2 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:06.263307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fb522-f497-42d5-9cbb-3994d88f81b2 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:06.270920 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf1ea0-7cff-439f-bab5-255f9f0f616b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:06.271927 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1ea0-7cff-439f-bab5-255f9f0f616b service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:06.272348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1ea0-7cff-439f-bab5-255f9f0f616b service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:06.272860 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1ea0-7cff-439f-bab5-255f9f0f616b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:06.283752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf1ea0-7cff-439f-bab5-255f9f0f616b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:06.285537 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf1ea0-7cff-439f-bab5-255f9f0f616b service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:06.298568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 677/1369] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:08.809853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a14f0-42c5-459a-aade-3c0524933d51 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:08.810776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a14f0-42c5-459a-aade-3c0524933d51 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:08.811213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a14f0-42c5-459a-aade-3c0524933d51 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:08.813564 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 693/1370] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:08.819328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daf1ff-367c-4158-aa25-9f5c0daf067e None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:08.819818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daf1ff-367c-4158-aa25-9f5c0daf067e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:08.819928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daf1ff-367c-4158-aa25-9f5c0daf067e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:08.823259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ec270-816a-4219-b237-eada7ca79c51 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:08.823693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ec270-816a-4219-b237-eada7ca79c51 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:08.824150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ec270-816a-4219-b237-eada7ca79c51 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:08.826115 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 694/1371] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:08.836468 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab428b-a862-4cd1-9d42-c1aa82fd1372 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:08.836834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab428b-a862-4cd1-9d42-c1aa82fd1372 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:08.837177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab428b-a862-4cd1-9d42-c1aa82fd1372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:08.840975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-63daf1ff-367c-4158-aa25-9f5c0daf067e None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:08.842220 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-63daf1ff-367c-4158-aa25-9f5c0daf067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:08.851330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 678/1372] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:08.858749 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-aeab428b-a862-4cd1-9d42-c1aa82fd1372 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:08.860924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-aeab428b-a862-4cd1-9d42-c1aa82fd1372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:08.870330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 695/1373] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:08.925617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daf1ff-367c-4158-aa25-9f5c0daf067e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:08.938116 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daf1ff-367c-4158-aa25-9f5c0daf067e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:08.943774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca739bb-0f6d-41c3-aeb8-41abfc0f64af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:08.944685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca739bb-0f6d-41c3-aeb8-41abfc0f64af service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:08.944971 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca739bb-0f6d-41c3-aeb8-41abfc0f64af service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:08.945242 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca739bb-0f6d-41c3-aeb8-41abfc0f64af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:08.954378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca739bb-0f6d-41c3-aeb8-41abfc0f64af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:08.955971 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca739bb-0f6d-41c3-aeb8-41abfc0f64af service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:08.965762 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 679/1374] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:09.123134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba311cb7-6033-4c28-8c41-6b32bb52c4ad None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:09.123432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba311cb7-6033-4c28-8c41-6b32bb52c4ad None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:09.123924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba311cb7-6033-4c28-8c41-6b32bb52c4ad None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:09.126257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 696/1375] 10.222.0.90 () {54 vars in 963 bytes} [Wed Feb 16 09:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:09.132124 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08e90-a6d3-476c-9c78-5efafefed004 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:09.132411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08e90-a6d3-476c-9c78-5efafefed004 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:09.132741 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08e90-a6d3-476c-9c78-5efafefed004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:09.189710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-d1b08e90-a6d3-476c-9c78-5efafefed004 None None] MFA Rules not processed for user `96e6c68eee11421bbb6b4066a856f228`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:09.191430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d1b08e90-a6d3-476c-9c78-5efafefed004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:09.267904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 680/1376] 10.222.0.90 () {58 vars in 1060 bytes} [Wed Feb 16 09:20:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:09.277205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba311cb7-6033-4c28-8c41-6b32bb52c4ad None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:09.290847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba311cb7-6033-4c28-8c41-6b32bb52c4ad None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:09.295427 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fdbb5-1bc0-46ea-aa30-de82e6df0a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:09.296390 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fdbb5-1bc0-46ea-aa30-de82e6df0a97 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:09.297465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fdbb5-1bc0-46ea-aa30-de82e6df0a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:09.298487 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fdbb5-1bc0-46ea-aa30-de82e6df0a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:09.309534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fdbb5-1bc0-46ea-aa30-de82e6df0a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:09.311151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83fdbb5-1bc0-46ea-aa30-de82e6df0a97 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:09.322934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 697/1377] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:11.408780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ed73e-aac2-4be6-b75d-4be8a1403ebb None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:11.409298 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ed73e-aac2-4be6-b75d-4be8a1403ebb None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:11.409418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ed73e-aac2-4be6-b75d-4be8a1403ebb None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:11.411101 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 681/1378] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:11.416701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042bcaa-a940-4797-b01e-f5a812531d10 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:11.417153 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042bcaa-a940-4797-b01e-f5a812531d10 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:11.417288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042bcaa-a940-4797-b01e-f5a812531d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:11.435822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d042bcaa-a940-4797-b01e-f5a812531d10 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:11.437055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d042bcaa-a940-4797-b01e-f5a812531d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:11.446793 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 698/1379] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:11.491711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ed73e-aac2-4be6-b75d-4be8a1403ebb None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:11.508806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ed73e-aac2-4be6-b75d-4be8a1403ebb None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:11.514580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76dd9bd-d2ba-42ed-986b-aeca14ce81a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:11.515212 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dd9bd-d2ba-42ed-986b-aeca14ce81a6 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:11.515488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dd9bd-d2ba-42ed-986b-aeca14ce81a6 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:11.515788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dd9bd-d2ba-42ed-986b-aeca14ce81a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:11.524251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76dd9bd-d2ba-42ed-986b-aeca14ce81a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:11.525832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76dd9bd-d2ba-42ed-986b-aeca14ce81a6 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:11.536235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 682/1380] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:13.941914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f3610-6c32-4906-86eb-341e60c3b97f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:13.942467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f3610-6c32-4906-86eb-341e60c3b97f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:13.942467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f3610-6c32-4906-86eb-341e60c3b97f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:13.944469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 699/1381] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:13.950132 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24c5bc-c03d-41b0-900d-778a581bae04 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:13.950610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24c5bc-c03d-41b0-900d-778a581bae04 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:13.950691 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24c5bc-c03d-41b0-900d-778a581bae04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:13.969871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-1b24c5bc-c03d-41b0-900d-778a581bae04 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:13.971075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1b24c5bc-c03d-41b0-900d-778a581bae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:13.979093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 683/1382] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:14.027996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f3610-6c32-4906-86eb-341e60c3b97f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:14.047476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f3610-6c32-4906-86eb-341e60c3b97f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:14.053158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf871a40-76b6-4582-b101-c398f53e9f29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:14.053910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871a40-76b6-4582-b101-c398f53e9f29 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:14.054305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871a40-76b6-4582-b101-c398f53e9f29 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:14.054687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf871a40-76b6-4582-b101-c398f53e9f29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:14.065371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf871a40-76b6-4582-b101-c398f53e9f29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:14.067108 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf871a40-76b6-4582-b101-c398f53e9f29 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:14.076901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 700/1383] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:16.535085 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9e50b-9d4b-4e46-b736-ee3dd97af5d8 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:16.535809 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9e50b-9d4b-4e46-b736-ee3dd97af5d8 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:16.535809 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9e50b-9d4b-4e46-b736-ee3dd97af5d8 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:16.537558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 684/1384] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:16.543282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465eff9-f646-48ac-a575-c15cd212fd54 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:16.543757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465eff9-f646-48ac-a575-c15cd212fd54 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:16.543845 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465eff9-f646-48ac-a575-c15cd212fd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:16.562853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f465eff9-f646-48ac-a575-c15cd212fd54 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:16.564164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f465eff9-f646-48ac-a575-c15cd212fd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:16.572585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 701/1385] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:16.615865 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9e50b-9d4b-4e46-b736-ee3dd97af5d8 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:16.635381 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9e50b-9d4b-4e46-b736-ee3dd97af5d8 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:16.646189 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43da413-0bb3-46dc-9a32-1dea867c27ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:16.647081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43da413-0bb3-46dc-9a32-1dea867c27ff service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:16.647428 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43da413-0bb3-46dc-9a32-1dea867c27ff service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:16.650806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43da413-0bb3-46dc-9a32-1dea867c27ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:16.665663 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43da413-0bb3-46dc-9a32-1dea867c27ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:16.669078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43da413-0bb3-46dc-9a32-1dea867c27ff service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:16.689019 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 685/1386] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:19.220176 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbcec-784d-438a-88d1-5ba42c97b54f None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:19.221114 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbcec-784d-438a-88d1-5ba42c97b54f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:19.221404 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbcec-784d-438a-88d1-5ba42c97b54f None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:19.223246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 702/1387] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:19.228861 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28295bf6-5483-4055-8388-ea5d757fd8dd None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:19.229370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28295bf6-5483-4055-8388-ea5d757fd8dd None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:19.229541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28295bf6-5483-4055-8388-ea5d757fd8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:19.250279 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-28295bf6-5483-4055-8388-ea5d757fd8dd None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:19.251806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-28295bf6-5483-4055-8388-ea5d757fd8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:19.263785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 686/1388] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:19.314336 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbcec-784d-438a-88d1-5ba42c97b54f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:19.333007 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbcec-784d-438a-88d1-5ba42c97b54f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:19.338839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f120a7-6905-4fcb-a3fb-9be6a3ae906e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:19.339281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f120a7-6905-4fcb-a3fb-9be6a3ae906e service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:19.339558 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f120a7-6905-4fcb-a3fb-9be6a3ae906e service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:19.339835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f120a7-6905-4fcb-a3fb-9be6a3ae906e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:19.350278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f120a7-6905-4fcb-a3fb-9be6a3ae906e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:19.351907 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f120a7-6905-4fcb-a3fb-9be6a3ae906e service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:19.363251 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 703/1389] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:21.840256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589c5f-e19d-4455-831b-914a3544324e None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:21.840990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589c5f-e19d-4455-831b-914a3544324e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:21.840990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589c5f-e19d-4455-831b-914a3544324e None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:21.842752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 687/1390] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:21.849607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e9214-7f1c-444c-b947-17f9043a269d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:21.850254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e9214-7f1c-444c-b947-17f9043a269d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:21.850254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e9214-7f1c-444c-b947-17f9043a269d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:21.868834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7a3e9214-7f1c-444c-b947-17f9043a269d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:21.870069 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7a3e9214-7f1c-444c-b947-17f9043a269d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:21.879856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 704/1391] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:20:21.932323 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589c5f-e19d-4455-831b-914a3544324e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:21.952173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589c5f-e19d-4455-831b-914a3544324e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:21.959562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bc852-9d3a-4a35-80ac-afbbe8bc028b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:21.960276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bc852-9d3a-4a35-80ac-afbbe8bc028b service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:21.960572 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bc852-9d3a-4a35-80ac-afbbe8bc028b service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:21.960860 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bc852-9d3a-4a35-80ac-afbbe8bc028b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:21.970878 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bc852-9d3a-4a35-80ac-afbbe8bc028b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:21.972660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bc852-9d3a-4a35-80ac-afbbe8bc028b service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:21.982990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 688/1392] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:24.441284 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1d4f7-a742-4b5e-ad0b-3345ab077da0 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:24.441827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1d4f7-a742-4b5e-ad0b-3345ab077da0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:24.441827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1d4f7-a742-4b5e-ad0b-3345ab077da0 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:24.447265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 705/1393] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:24.449260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e918052-279e-4ed2-b938-b9655cd8dfda None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:24.449695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e918052-279e-4ed2-b938-b9655cd8dfda None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:24.449822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e918052-279e-4ed2-b938-b9655cd8dfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:24.470323 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-8e918052-279e-4ed2-b938-b9655cd8dfda None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:24.471530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8e918052-279e-4ed2-b938-b9655cd8dfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:24.480210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 689/1394] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:24.527810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1d4f7-a742-4b5e-ad0b-3345ab077da0 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:24.542645 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1d4f7-a742-4b5e-ad0b-3345ab077da0 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:24.550022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cef81-b891-4477-86b3-a83d5e562494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:24.550667 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cef81-b891-4477-86b3-a83d5e562494 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:24.550944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cef81-b891-4477-86b3-a83d5e562494 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:24.551220 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cef81-b891-4477-86b3-a83d5e562494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:24.560586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cef81-b891-4477-86b3-a83d5e562494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:24.563320 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cef81-b891-4477-86b3-a83d5e562494 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:24.574192 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 706/1395] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:25.372240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21366377-d9d2-4633-8a7f-4ab165562466 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:25.373057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21366377-d9d2-4633-8a7f-4ab165562466 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:25.373057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21366377-d9d2-4633-8a7f-4ab165562466 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:25.374960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 690/1396] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:25.380589 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15123417-39a5-4bd8-9521-7ec079f8ac00 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:25.380891 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15123417-39a5-4bd8-9521-7ec079f8ac00 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:25.381174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15123417-39a5-4bd8-9521-7ec079f8ac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:25.400170 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-15123417-39a5-4bd8-9521-7ec079f8ac00 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:25.401782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-15123417-39a5-4bd8-9521-7ec079f8ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:25.415914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 707/1397] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:20:25.498813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e379f47-9b3a-4721-a2bd-e17a4c2acc7d None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:25.499943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e379f47-9b3a-4721-a2bd-e17a4c2acc7d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:25.500216 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e379f47-9b3a-4721-a2bd-e17a4c2acc7d None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:25.502274 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 691/1398] 10.222.0.90 () {54 vars in 962 bytes} [Wed Feb 16 09:20:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:25.508226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bea1b-d28c-4274-b932-bd250d1c08c5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:25.508801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bea1b-d28c-4274-b932-bd250d1c08c5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:25.508801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bea1b-d28c-4274-b932-bd250d1c08c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:25.582262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ac7bea1b-d28c-4274-b932-bd250d1c08c5 None None] MFA Rules not processed for user `5074090dca0b4a49b54dc252a5dd9420`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:25.583479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ac7bea1b-d28c-4274-b932-bd250d1c08c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:25.663604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 708/1399] 10.222.0.90 () {58 vars in 1059 bytes} [Wed Feb 16 09:20:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:25.671933 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e379f47-9b3a-4721-a2bd-e17a4c2acc7d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:25.685681 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e379f47-9b3a-4721-a2bd-e17a4c2acc7d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:25.691395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb75c07-faf3-460d-9fac-6fe758c56e9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5074090dca0b4a49b54dc252a5dd9420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:25.692066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb75c07-faf3-460d-9fac-6fe758c56e9d service glance] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:25.692355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb75c07-faf3-460d-9fac-6fe758c56e9d service glance] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:25.692630 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb75c07-faf3-460d-9fac-6fe758c56e9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:25.702956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb75c07-faf3-460d-9fac-6fe758c56e9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:25.704740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb75c07-faf3-460d-9fac-6fe758c56e9d service glance] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:25.719620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 692/1400] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:26.267055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90912-5af1-4a81-84d7-89660ccc87e3 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:26.267407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90912-5af1-4a81-84d7-89660ccc87e3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:26.267678 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf90912-5af1-4a81-84d7-89660ccc87e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:26.321206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-bbf90912-5af1-4a81-84d7-89660ccc87e3 None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:26.322396 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bbf90912-5af1-4a81-84d7-89660ccc87e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:26.388091 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 709/1401] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:20:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:26.439295 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54bcb3-d441-4494-8e22-660a992f058c None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:26.439783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54bcb3-d441-4494-8e22-660a992f058c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:26.442025 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54bcb3-d441-4494-8e22-660a992f058c None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:26.442888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 693/1402] 10.222.0.90 () {54 vars in 942 bytes} [Wed Feb 16 09:20:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:26.449457 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58292e76-af41-4fd5-99d9-4b8e1d505cb4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:26.449930 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58292e76-af41-4fd5-99d9-4b8e1d505cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:26.450409 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58292e76-af41-4fd5-99d9-4b8e1d505cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:26.506402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-58292e76-af41-4fd5-99d9-4b8e1d505cb4 None None] MFA Rules not processed for user `faf1f200fb2b4a2fb75b971054885eef`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:26.507503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-58292e76-af41-4fd5-99d9-4b8e1d505cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:26.589660 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 710/1403] 10.222.0.90 () {58 vars in 1039 bytes} [Wed Feb 16 09:20:26 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:26.602653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54bcb3-d441-4494-8e22-660a992f058c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:26.620216 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54bcb3-d441-4494-8e22-660a992f058c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:26.626497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d2899-8fcb-4298-9d06-f8dc8b47c089 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:26.626804 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d2899-8fcb-4298-9d06-f8dc8b47c089 service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:26.626951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d2899-8fcb-4298-9d06-f8dc8b47c089 service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:26.627227 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d2899-8fcb-4298-9d06-f8dc8b47c089 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:26.635856 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d2899-8fcb-4298-9d06-f8dc8b47c089 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:26.637483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d2899-8fcb-4298-9d06-f8dc8b47c089 service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:26.646238 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 694/1404] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:20:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:20:27.067242 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f143fb-6d1a-4b83-84d6-7e4b6a882da3 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:27.067784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f143fb-6d1a-4b83-84d6-7e4b6a882da3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:27.068092 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f143fb-6d1a-4b83-84d6-7e4b6a882da3 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:27.070052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 711/1405] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:27.075578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3981d-3bb3-4c4b-8020-945c70a668ba None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:27.075941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3981d-3bb3-4c4b-8020-945c70a668ba None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:27.076304 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3981d-3bb3-4c4b-8020-945c70a668ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:27.098117 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-72d3981d-3bb3-4c4b-8020-945c70a668ba None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:27.099653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-72d3981d-3bb3-4c4b-8020-945c70a668ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:27.110700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 695/1406] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:20:27.163627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f143fb-6d1a-4b83-84d6-7e4b6a882da3 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:27.187712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f143fb-6d1a-4b83-84d6-7e4b6a882da3 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:27.196094 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6beaac-4d09-4cba-b10f-6baa7fcdd63f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:27.197020 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6beaac-4d09-4cba-b10f-6baa7fcdd63f service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:27.197484 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6beaac-4d09-4cba-b10f-6baa7fcdd63f service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:27.197771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6beaac-4d09-4cba-b10f-6baa7fcdd63f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:27.213753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6beaac-4d09-4cba-b10f-6baa7fcdd63f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:27.215360 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6beaac-4d09-4cba-b10f-6baa7fcdd63f service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:27.225516 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 712/1407] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:20:29.697267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f219fc2-0a82-4f99-802c-487244bfa09e None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:29.697874 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f219fc2-0a82-4f99-802c-487244bfa09e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:29.697874 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f219fc2-0a82-4f99-802c-487244bfa09e None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:29.699583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 696/1408] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:29.706171 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380bf51-cc30-4d1e-bdcd-52019dcbbb52 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:29.707427 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380bf51-cc30-4d1e-bdcd-52019dcbbb52 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:29.708076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380bf51-cc30-4d1e-bdcd-52019dcbbb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:29.732917 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e380bf51-cc30-4d1e-bdcd-52019dcbbb52 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:29.736479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e380bf51-cc30-4d1e-bdcd-52019dcbbb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:29.745158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 713/1409] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:20:29.793947 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f219fc2-0a82-4f99-802c-487244bfa09e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:29.809092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f219fc2-0a82-4f99-802c-487244bfa09e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:29.815785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6c908-0135-4f17-83dc-063b9e4d6b8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:29.817717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6c908-0135-4f17-83dc-063b9e4d6b8f service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:29.818976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6c908-0135-4f17-83dc-063b9e4d6b8f service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:29.819675 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6c908-0135-4f17-83dc-063b9e4d6b8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:29.832799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6c908-0135-4f17-83dc-063b9e4d6b8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:29.834398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6c908-0135-4f17-83dc-063b9e4d6b8f service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:29.845210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 697/1410] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:50.299398 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873379-2cd7-4129-af42-2e274075e9ac None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:50.302068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873379-2cd7-4129-af42-2e274075e9ac None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:50.302068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873379-2cd7-4129-af42-2e274075e9ac None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:50.302469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 714/1411] 10.222.0.90 () {54 vars in 918 bytes} [Wed Feb 16 09:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:50.308520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296b565-5757-4c2a-9d00-40bfb8f4c63c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:50.309023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296b565-5757-4c2a-9d00-40bfb8f4c63c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:50.309131 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296b565-5757-4c2a-9d00-40bfb8f4c63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:50.331369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-d296b565-5757-4c2a-9d00-40bfb8f4c63c None None] MFA Rules not processed for user `7d870fbd90cb4fde9ceafd2b737795eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:50.332611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d296b565-5757-4c2a-9d00-40bfb8f4c63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:50.341377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 698/1412] 10.222.0.90 () {58 vars in 1015 bytes} [Wed Feb 16 09:20:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:50.355807 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29b36c-736f-451b-b03b-9438e120adf9 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:50.356128 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29b36c-736f-451b-b03b-9438e120adf9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:50.356685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29b36c-736f-451b-b03b-9438e120adf9 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:50.358794 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 715/1413] 10.222.0.90 () {54 vars in 918 bytes} [Wed Feb 16 09:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:50.363422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf1698-8509-4fbd-bdc2-c22a2c6ae92c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:50.363711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf1698-8509-4fbd-bdc2-c22a2c6ae92c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:50.363989 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf1698-8509-4fbd-bdc2-c22a2c6ae92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:50.382598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-1bbf1698-8509-4fbd-bdc2-c22a2c6ae92c None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:50.383774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1bbf1698-8509-4fbd-bdc2-c22a2c6ae92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:50.394318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 699/1414] 10.222.0.90 () {58 vars in 1015 bytes} [Wed Feb 16 09:20:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:53.262475 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d859d-b885-424f-a1c3-965936bfd246 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:53.263585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d859d-b885-424f-a1c3-965936bfd246 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:53.263683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d859d-b885-424f-a1c3-965936bfd246 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:53.265833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 716/1415] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:53.271936 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f83997-a152-4e4a-b76f-f45ba115f715 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:53.272423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f83997-a152-4e4a-b76f-f45ba115f715 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:53.272531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f83997-a152-4e4a-b76f-f45ba115f715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:53.291861 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-b6f83997-a152-4e4a-b76f-f45ba115f715 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:53.293122 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-b6f83997-a152-4e4a-b76f-f45ba115f715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:53.303556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 700/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:53.346899 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d859d-b885-424f-a1c3-965936bfd246 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:53.360960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d859d-b885-424f-a1c3-965936bfd246 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:53.366364 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d87f6b-b59f-4964-8378-a21bb54055ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:53.366979 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d87f6b-b59f-4964-8378-a21bb54055ec service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:53.367256 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d87f6b-b59f-4964-8378-a21bb54055ec service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:53.367527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d87f6b-b59f-4964-8378-a21bb54055ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:53.377055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d87f6b-b59f-4964-8378-a21bb54055ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:53.378641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d87f6b-b59f-4964-8378-a21bb54055ec service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:53.388650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 717/1417] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:54.812172 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceeece-f6d7-47f3-a3dc-d52be92fb52a None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:54.812760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceeece-f6d7-47f3-a3dc-d52be92fb52a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:54.812760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ceeece-f6d7-47f3-a3dc-d52be92fb52a None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:54.814473 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 701/1418] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 09:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:54.819504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4b7f7-f0ed-49d0-94c7-badeade072c0 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:54.819955 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4b7f7-f0ed-49d0-94c7-badeade072c0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:54.820070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4b7f7-f0ed-49d0-94c7-badeade072c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:54.838536 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e2a4b7f7-f0ed-49d0-94c7-badeade072c0 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:54.839739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e2a4b7f7-f0ed-49d0-94c7-badeade072c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:54.847869 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 718/1419] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 09:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:55.037949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceeece-f6d7-47f3-a3dc-d52be92fb52a None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:55.052407 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ceeece-f6d7-47f3-a3dc-d52be92fb52a None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:55.057705 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d57b7-ddd9-451a-9e5d-1be3d2a8353f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:55.058331 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d57b7-ddd9-451a-9e5d-1be3d2a8353f service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:55.058614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d57b7-ddd9-451a-9e5d-1be3d2a8353f service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:55.058889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d57b7-ddd9-451a-9e5d-1be3d2a8353f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:55.069010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d57b7-ddd9-451a-9e5d-1be3d2a8353f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:55.071527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d57b7-ddd9-451a-9e5d-1be3d2a8353f service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:55.086023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 702/1420] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:56.457277 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eb65c-2509-46e2-9433-7c32cb90be70 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:56.457868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eb65c-2509-46e2-9433-7c32cb90be70 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:56.457868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38eb65c-2509-46e2-9433-7c32cb90be70 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:56.459620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 719/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 09:20:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:56.464872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57000289-a3c9-4211-8ab7-1eb0da276051 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:56.465421 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57000289-a3c9-4211-8ab7-1eb0da276051 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:56.465606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57000289-a3c9-4211-8ab7-1eb0da276051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:56.484899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-57000289-a3c9-4211-8ab7-1eb0da276051 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:56.486102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-57000289-a3c9-4211-8ab7-1eb0da276051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:56.494445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 703/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 09:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:20:56.647737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38eb65c-2509-46e2-9433-7c32cb90be70 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:56.665599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38eb65c-2509-46e2-9433-7c32cb90be70 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:56.671691 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96d5f2-5eab-43a8-8dda-fedba751a837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:56.672365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d5f2-5eab-43a8-8dda-fedba751a837 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:56.672642 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d5f2-5eab-43a8-8dda-fedba751a837 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:56.672953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96d5f2-5eab-43a8-8dda-fedba751a837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:56.681534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d5f2-5eab-43a8-8dda-fedba751a837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:56.683116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96d5f2-5eab-43a8-8dda-fedba751a837 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:56.693269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 720/1423] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:58.033651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bcd94-2d5d-469d-97b5-6265fc68f24f None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:58.034168 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bcd94-2d5d-469d-97b5-6265fc68f24f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:58.034281 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bcd94-2d5d-469d-97b5-6265fc68f24f None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:58.036078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 704/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 09:20:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:58.041544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f19f47-947d-4190-88d9-e1634fbcf358 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:58.041985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f19f47-947d-4190-88d9-e1634fbcf358 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:58.042082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f19f47-947d-4190-88d9-e1634fbcf358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:58.061141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d4f19f47-947d-4190-88d9-e1634fbcf358 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:58.062334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d4f19f47-947d-4190-88d9-e1634fbcf358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:58.070001 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 721/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 09:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:58.235903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bcd94-2d5d-469d-97b5-6265fc68f24f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:58.249952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bcd94-2d5d-469d-97b5-6265fc68f24f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:58.255447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d1202-9b4f-4816-adce-702a106260e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:58.256103 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d1202-9b4f-4816-adce-702a106260e3 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:58.256381 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d1202-9b4f-4816-adce-702a106260e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:58.256648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d1202-9b4f-4816-adce-702a106260e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:58.265357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d1202-9b4f-4816-adce-702a106260e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:58.266852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d1202-9b4f-4816-adce-702a106260e3 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:58.276635 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 705/1426] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:20:59.603456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafed7a-7790-4ce6-b261-07feed544696 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:59.604049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafed7a-7790-4ce6-b261-07feed544696 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:59.604049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafed7a-7790-4ce6-b261-07feed544696 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:59.606486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 722/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 09:20:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:20:59.611207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8372f8-8a7e-4ba7-b310-dffdd9456b51 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:59.611654 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8372f8-8a7e-4ba7-b310-dffdd9456b51 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:59.611762 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8372f8-8a7e-4ba7-b310-dffdd9456b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:59.629314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-eb8372f8-8a7e-4ba7-b310-dffdd9456b51 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:20:59.630482 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-eb8372f8-8a7e-4ba7-b310-dffdd9456b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:20:59.638729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 706/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 09:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:20:59.793452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafed7a-7790-4ce6-b261-07feed544696 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:20:59.807264 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafed7a-7790-4ce6-b261-07feed544696 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:20:59.813122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6367abb-0e52-4870-9f3f-bef7f80e83e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:20:59.813741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6367abb-0e52-4870-9f3f-bef7f80e83e5 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:20:59.814025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6367abb-0e52-4870-9f3f-bef7f80e83e5 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:20:59.814296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6367abb-0e52-4870-9f3f-bef7f80e83e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:20:59.822294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6367abb-0e52-4870-9f3f-bef7f80e83e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:20:59.823867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6367abb-0e52-4870-9f3f-bef7f80e83e5 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:20:59.834166 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 723/1429] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:01.096002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558d8cd-c837-4b59-ada7-d5a72bbb573e None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:01.096604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558d8cd-c837-4b59-ada7-d5a72bbb573e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:01.096604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558d8cd-c837-4b59-ada7-d5a72bbb573e None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:01.098361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 707/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 09:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:01.103656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc17ac-f84a-4742-95ae-26ef9a8d0cef None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:01.104173 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc17ac-f84a-4742-95ae-26ef9a8d0cef None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:01.104267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc17ac-f84a-4742-95ae-26ef9a8d0cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:01.123467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a1bc17ac-f84a-4742-95ae-26ef9a8d0cef None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:01.124702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a1bc17ac-f84a-4742-95ae-26ef9a8d0cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:01.132617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 724/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 09:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:01.290104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558d8cd-c837-4b59-ada7-d5a72bbb573e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:01.304424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558d8cd-c837-4b59-ada7-d5a72bbb573e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:01.310522 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78166fcb-bfe4-432b-8c00-8f92a3a136b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:01.311155 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78166fcb-bfe4-432b-8c00-8f92a3a136b5 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:01.311435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78166fcb-bfe4-432b-8c00-8f92a3a136b5 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:01.311710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78166fcb-bfe4-432b-8c00-8f92a3a136b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:01.320041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78166fcb-bfe4-432b-8c00-8f92a3a136b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:01.321622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78166fcb-bfe4-432b-8c00-8f92a3a136b5 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:01.332436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 708/1432] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:02.611304 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310fdd3-e0e2-4129-964d-e94b71862711 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:02.611859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310fdd3-e0e2-4129-964d-e94b71862711 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:02.611859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310fdd3-e0e2-4129-964d-e94b71862711 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:02.613677 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 725/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 09:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:02.618734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ce60b-0aba-43a9-b70e-fed7f1fdd671 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:02.619191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ce60b-0aba-43a9-b70e-fed7f1fdd671 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:02.619322 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ce60b-0aba-43a9-b70e-fed7f1fdd671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:02.638216 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-135ce60b-0aba-43a9-b70e-fed7f1fdd671 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:02.639416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-135ce60b-0aba-43a9-b70e-fed7f1fdd671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:02.647129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 709/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 09:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:02.799929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310fdd3-e0e2-4129-964d-e94b71862711 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:02.814891 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310fdd3-e0e2-4129-964d-e94b71862711 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:02.820309 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672779ad-2cf4-4120-97d3-9e6e3b0a0062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:02.820937 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672779ad-2cf4-4120-97d3-9e6e3b0a0062 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:02.821220 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672779ad-2cf4-4120-97d3-9e6e3b0a0062 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:02.821498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672779ad-2cf4-4120-97d3-9e6e3b0a0062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:02.830389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672779ad-2cf4-4120-97d3-9e6e3b0a0062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:02.831978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672779ad-2cf4-4120-97d3-9e6e3b0a0062 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:02.841430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 726/1435] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:04.107554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bef7c-ef8a-4ac0-beb4-984454e4fbb5 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:04.108144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bef7c-ef8a-4ac0-beb4-984454e4fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:04.108144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bef7c-ef8a-4ac0-beb4-984454e4fbb5 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:04.110006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 710/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 09:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:04.115143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6760bf7-1fc9-4087-b5f8-955aa57f3858 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:04.115550 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6760bf7-1fc9-4087-b5f8-955aa57f3858 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:04.115689 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6760bf7-1fc9-4087-b5f8-955aa57f3858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:04.134334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a6760bf7-1fc9-4087-b5f8-955aa57f3858 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:04.135511 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a6760bf7-1fc9-4087-b5f8-955aa57f3858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:04.143720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 727/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 09:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:04.299232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bef7c-ef8a-4ac0-beb4-984454e4fbb5 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:04.316282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bef7c-ef8a-4ac0-beb4-984454e4fbb5 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:04.321752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ca17a-4b66-4a8a-babf-46e6208ca7a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:04.322388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ca17a-4b66-4a8a-babf-46e6208ca7a7 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:04.322667 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ca17a-4b66-4a8a-babf-46e6208ca7a7 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:04.322943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ca17a-4b66-4a8a-babf-46e6208ca7a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:04.331954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ca17a-4b66-4a8a-babf-46e6208ca7a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:04.333559 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ca17a-4b66-4a8a-babf-46e6208ca7a7 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:04.343072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 711/1438] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:05.627207 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5853f3-6023-4b72-b948-48e4071366b5 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:05.627791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5853f3-6023-4b72-b948-48e4071366b5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:05.627791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5853f3-6023-4b72-b948-48e4071366b5 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:05.629564 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 728/1439] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 09:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:05.634499 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30861449-b69d-4382-b415-c9c6b7021bbf None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:05.634929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30861449-b69d-4382-b415-c9c6b7021bbf None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:05.635050 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30861449-b69d-4382-b415-c9c6b7021bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:05.654300 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-30861449-b69d-4382-b415-c9c6b7021bbf None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:05.655491 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-30861449-b69d-4382-b415-c9c6b7021bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:05.664086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 712/1440] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 09:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:05.819638 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5853f3-6023-4b72-b948-48e4071366b5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:05.834336 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5853f3-6023-4b72-b948-48e4071366b5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:05.839759 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24efb5-18d3-45e4-9135-91d94932b8bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:05.840611 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24efb5-18d3-45e4-9135-91d94932b8bb service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:05.840893 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24efb5-18d3-45e4-9135-91d94932b8bb service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:05.841168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24efb5-18d3-45e4-9135-91d94932b8bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:05.849917 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24efb5-18d3-45e4-9135-91d94932b8bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:05.851539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24efb5-18d3-45e4-9135-91d94932b8bb service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:05.861309 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 729/1441] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:08.170099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd34704-ea89-4f45-9dc1-05d74d3bb0b0 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:08.170647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd34704-ea89-4f45-9dc1-05d74d3bb0b0 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:08.170647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd34704-ea89-4f45-9dc1-05d74d3bb0b0 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:08.172447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 713/1442] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:08.177777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264326b8-cbe3-4787-ab01-b5dca7d11e02 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:08.178241 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264326b8-cbe3-4787-ab01-b5dca7d11e02 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:08.178334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264326b8-cbe3-4787-ab01-b5dca7d11e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:08.196414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-264326b8-cbe3-4787-ab01-b5dca7d11e02 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:08.197617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-264326b8-cbe3-4787-ab01-b5dca7d11e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:08.206246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 730/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:08.243798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd34704-ea89-4f45-9dc1-05d74d3bb0b0 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:08.254853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd34704-ea89-4f45-9dc1-05d74d3bb0b0 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:08.258355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8155f7e-7c7e-4e0d-ac18-de0bccce6039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:08.258975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8155f7e-7c7e-4e0d-ac18-de0bccce6039 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:08.259253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8155f7e-7c7e-4e0d-ac18-de0bccce6039 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:08.259536 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8155f7e-7c7e-4e0d-ac18-de0bccce6039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:08.269645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8155f7e-7c7e-4e0d-ac18-de0bccce6039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:08.271397 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8155f7e-7c7e-4e0d-ac18-de0bccce6039 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:08.281845 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 714/1444] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:10.756476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f2923-5b9d-48a9-a5e0-ad0ea067d3f2 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:10.757075 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f2923-5b9d-48a9-a5e0-ad0ea067d3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:10.757075 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f2923-5b9d-48a9-a5e0-ad0ea067d3f2 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:10.758809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 731/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:10.764911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d17678-4f47-4d76-9ad1-42166909386a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:10.765408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d17678-4f47-4d76-9ad1-42166909386a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:10.765517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d17678-4f47-4d76-9ad1-42166909386a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:10.783445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-c5d17678-4f47-4d76-9ad1-42166909386a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:10.784656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c5d17678-4f47-4d76-9ad1-42166909386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:10.793024 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 715/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:21:10.832169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f2923-5b9d-48a9-a5e0-ad0ea067d3f2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:10.843038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f2923-5b9d-48a9-a5e0-ad0ea067d3f2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:10.846541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947c88a-7d82-450c-949e-58060e74f260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:10.847156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947c88a-7d82-450c-949e-58060e74f260 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:10.847430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947c88a-7d82-450c-949e-58060e74f260 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:10.847698 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947c88a-7d82-450c-949e-58060e74f260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:10.857041 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947c88a-7d82-450c-949e-58060e74f260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:10.858461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947c88a-7d82-450c-949e-58060e74f260 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:10.867457 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 732/1447] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:13.563005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67defc29-3a7b-4b17-94f1-0887ad58f31d None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:13.563588 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67defc29-3a7b-4b17-94f1-0887ad58f31d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:13.563588 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67defc29-3a7b-4b17-94f1-0887ad58f31d None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:13.565381 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 716/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:13.570710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeec747-df02-4e34-8d96-52b4ef7a9cd7 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:13.571171 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeec747-df02-4e34-8d96-52b4ef7a9cd7 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:13.571278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeec747-df02-4e34-8d96-52b4ef7a9cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:13.589648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5eeec747-df02-4e34-8d96-52b4ef7a9cd7 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:13.591034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5eeec747-df02-4e34-8d96-52b4ef7a9cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:13.602841 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 733/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:13.653478 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67defc29-3a7b-4b17-94f1-0887ad58f31d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:13.664006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67defc29-3a7b-4b17-94f1-0887ad58f31d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:13.668088 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd810eb5-f2e5-4237-8095-c8dfb8ffd239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:13.668711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd810eb5-f2e5-4237-8095-c8dfb8ffd239 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:13.668984 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd810eb5-f2e5-4237-8095-c8dfb8ffd239 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:13.669248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd810eb5-f2e5-4237-8095-c8dfb8ffd239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:13.679099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd810eb5-f2e5-4237-8095-c8dfb8ffd239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:13.680570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd810eb5-f2e5-4237-8095-c8dfb8ffd239 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:13.690673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 717/1450] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:16.150212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100669-451c-4c4e-ba38-d6467b8aa30b None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:16.150719 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100669-451c-4c4e-ba38-d6467b8aa30b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:16.150829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100669-451c-4c4e-ba38-d6467b8aa30b None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:16.153317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 734/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:16.158612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eff2b6-16b1-408e-938e-e6f8de43898a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:16.159054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eff2b6-16b1-408e-938e-e6f8de43898a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:16.159170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eff2b6-16b1-408e-938e-e6f8de43898a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:16.176692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-36eff2b6-16b1-408e-938e-e6f8de43898a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:16.177889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-36eff2b6-16b1-408e-938e-e6f8de43898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:16.186112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 718/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:21:16.226697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100669-451c-4c4e-ba38-d6467b8aa30b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:16.237368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100669-451c-4c4e-ba38-d6467b8aa30b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:16.240924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8f674-b14a-4412-b84c-bf016da9497d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:16.241555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8f674-b14a-4412-b84c-bf016da9497d service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:16.241834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8f674-b14a-4412-b84c-bf016da9497d service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:16.242105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8f674-b14a-4412-b84c-bf016da9497d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:16.251387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8f674-b14a-4412-b84c-bf016da9497d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:16.252868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8f674-b14a-4412-b84c-bf016da9497d service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:16.262864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 735/1453] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:18.670371 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd49e09-0a88-4fb0-8d25-c64ee4917f4e None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:18.670926 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd49e09-0a88-4fb0-8d25-c64ee4917f4e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:18.670926 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd49e09-0a88-4fb0-8d25-c64ee4917f4e None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:18.672734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 719/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:18.678043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226fef-8d54-4139-acfc-38ed2543f25d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:18.678498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226fef-8d54-4139-acfc-38ed2543f25d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:18.678609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60226fef-8d54-4139-acfc-38ed2543f25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:18.696770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-60226fef-8d54-4139-acfc-38ed2543f25d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:18.697975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-60226fef-8d54-4139-acfc-38ed2543f25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:18.707969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 736/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:18.748467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd49e09-0a88-4fb0-8d25-c64ee4917f4e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:18.759002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd49e09-0a88-4fb0-8d25-c64ee4917f4e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:18.763121 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fd20e-fc40-4f15-bffc-088d35c44f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:18.763757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd20e-fc40-4f15-bffc-088d35c44f3b service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:18.764053 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd20e-fc40-4f15-bffc-088d35c44f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:18.764333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fd20e-fc40-4f15-bffc-088d35c44f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:18.773496 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fd20e-fc40-4f15-bffc-088d35c44f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:18.775185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fd20e-fc40-4f15-bffc-088d35c44f3b service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:18.785606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 720/1456] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:21.201512 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfad885-50a9-4a8f-934b-8ec28c3b3294 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:21.202081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfad885-50a9-4a8f-934b-8ec28c3b3294 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:21.202081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfad885-50a9-4a8f-934b-8ec28c3b3294 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:21.203925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 737/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:21.209425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0429a-163e-4bb5-b43b-54418d9605f7 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:21.209907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0429a-163e-4bb5-b43b-54418d9605f7 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:21.210014 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0429a-163e-4bb5-b43b-54418d9605f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:21.230581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-31f0429a-163e-4bb5-b43b-54418d9605f7 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:21.231781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-31f0429a-163e-4bb5-b43b-54418d9605f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:21.239537 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 721/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:21.278673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfad885-50a9-4a8f-934b-8ec28c3b3294 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:21.291071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfad885-50a9-4a8f-934b-8ec28c3b3294 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:21.294749 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25da6f5-6c61-4f48-87f4-a6da8e80e52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:21.295374 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25da6f5-6c61-4f48-87f4-a6da8e80e52d service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:21.295651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25da6f5-6c61-4f48-87f4-a6da8e80e52d service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:21.295923 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25da6f5-6c61-4f48-87f4-a6da8e80e52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:21.305075 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25da6f5-6c61-4f48-87f4-a6da8e80e52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:21.306508 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25da6f5-6c61-4f48-87f4-a6da8e80e52d service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:21.316069 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 738/1459] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:23.747920 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a284c-e64a-4082-b129-cfe8468b79c5 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:23.748539 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a284c-e64a-4082-b129-cfe8468b79c5 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:23.748539 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a284c-e64a-4082-b129-cfe8468b79c5 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:23.750286 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 722/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:23.755756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1a31b-0cd0-4f7e-ad9a-acac9d156574 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:23.756234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1a31b-0cd0-4f7e-ad9a-acac9d156574 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:23.756352 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1a31b-0cd0-4f7e-ad9a-acac9d156574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:23.774639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-cfe1a31b-0cd0-4f7e-ad9a-acac9d156574 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:23.776395 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cfe1a31b-0cd0-4f7e-ad9a-acac9d156574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:23.784774 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 739/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:23.823944 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a284c-e64a-4082-b129-cfe8468b79c5 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:23.834502 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a284c-e64a-4082-b129-cfe8468b79c5 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:23.838067 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598acfd7-3f65-476e-a071-39525327a196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:23.839312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598acfd7-3f65-476e-a071-39525327a196 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:23.839697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598acfd7-3f65-476e-a071-39525327a196 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:23.839981 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598acfd7-3f65-476e-a071-39525327a196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:23.849146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598acfd7-3f65-476e-a071-39525327a196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:23.850568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598acfd7-3f65-476e-a071-39525327a196 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:23.861012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 723/1462] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:26.265623 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b47a9-e7cf-4c8b-83e8-66f4cb293b57 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:26.267421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b47a9-e7cf-4c8b-83e8-66f4cb293b57 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:26.267421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b47a9-e7cf-4c8b-83e8-66f4cb293b57 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:26.267888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 740/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:26.273380 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53cf56-44a6-4313-bfdd-b17800ad339b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:26.274341 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53cf56-44a6-4313-bfdd-b17800ad339b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:26.274341 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53cf56-44a6-4313-bfdd-b17800ad339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:26.291801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-bd53cf56-44a6-4313-bfdd-b17800ad339b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:26.293183 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-bd53cf56-44a6-4313-bfdd-b17800ad339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:26.300976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 724/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:21:26.340043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b47a9-e7cf-4c8b-83e8-66f4cb293b57 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:26.352138 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b47a9-e7cf-4c8b-83e8-66f4cb293b57 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:26.356299 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a7c94-3fdc-4ebc-96c3-8677a60ad0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:26.356930 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a7c94-3fdc-4ebc-96c3-8677a60ad0fb service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:26.357211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a7c94-3fdc-4ebc-96c3-8677a60ad0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:26.357484 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a7c94-3fdc-4ebc-96c3-8677a60ad0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:26.370042 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a7c94-3fdc-4ebc-96c3-8677a60ad0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:26.371519 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a7c94-3fdc-4ebc-96c3-8677a60ad0fb service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:26.381314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 741/1465] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:28.869013 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60509786-f816-4521-b18c-431b6acf8db8 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:28.870217 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60509786-f816-4521-b18c-431b6acf8db8 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:28.870317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60509786-f816-4521-b18c-431b6acf8db8 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:28.872432 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 725/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:21:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:28.878022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc779d-512c-4929-98ab-2aed9121bde9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:28.878514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc779d-512c-4929-98ab-2aed9121bde9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:28.878630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc779d-512c-4929-98ab-2aed9121bde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:28.897116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-37bc779d-512c-4929-98ab-2aed9121bde9 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:28.898306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-37bc779d-512c-4929-98ab-2aed9121bde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:28.906875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 742/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:28.947617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60509786-f816-4521-b18c-431b6acf8db8 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:28.949575 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-60509786-f816-4521-b18c-431b6acf8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:28.966414 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60509786-f816-4521-b18c-431b6acf8db8 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:28.970340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848715a-efdd-449e-a028-4180d69cf44e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:28.970985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848715a-efdd-449e-a028-4180d69cf44e service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:28.971262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848715a-efdd-449e-a028-4180d69cf44e service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:28.971533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848715a-efdd-449e-a028-4180d69cf44e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:28.982013 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848715a-efdd-449e-a028-4180d69cf44e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:28.983441 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848715a-efdd-449e-a028-4180d69cf44e service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:28.992866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 726/1468] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:31.376184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c623cd-f227-4ec1-b5cc-30192555194b None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:31.376781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c623cd-f227-4ec1-b5cc-30192555194b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:31.376781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c623cd-f227-4ec1-b5cc-30192555194b None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:31.378505 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 743/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:31.384487 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400a46-bef9-4a8b-a087-2f38307797ba None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:31.385609 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400a46-bef9-4a8b-a087-2f38307797ba None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:31.386042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400a46-bef9-4a8b-a087-2f38307797ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:31.407891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-64400a46-bef9-4a8b-a087-2f38307797ba None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:31.409127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-64400a46-bef9-4a8b-a087-2f38307797ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:31.417265 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 727/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:31.454949 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c623cd-f227-4ec1-b5cc-30192555194b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:31.466333 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c623cd-f227-4ec1-b5cc-30192555194b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:31.469858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5edb6-81b9-4609-b723-685f4cf3a3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:31.470486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5edb6-81b9-4609-b723-685f4cf3a3dc service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:31.470765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5edb6-81b9-4609-b723-685f4cf3a3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:31.471040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5edb6-81b9-4609-b723-685f4cf3a3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:31.481308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5edb6-81b9-4609-b723-685f4cf3a3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:31.482759 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5edb6-81b9-4609-b723-685f4cf3a3dc service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:31.492266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 744/1471] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:52.605213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f3914-af2e-4a0d-815d-fe23fb764732 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:52.605839 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f3914-af2e-4a0d-815d-fe23fb764732 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:52.605839 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f3914-af2e-4a0d-815d-fe23fb764732 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:52.607598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 728/1472] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:21:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:52.612929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5394d01-90a8-4c0f-9818-b665ee0a0dce None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:52.613340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5394d01-90a8-4c0f-9818-b665ee0a0dce None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:52.613493 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5394d01-90a8-4c0f-9818-b665ee0a0dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:52.631101 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d5394d01-90a8-4c0f-9818-b665ee0a0dce None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:52.632317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d5394d01-90a8-4c0f-9818-b665ee0a0dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:52.640347 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 745/1473] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:52.687255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8c71-af61-478e-bb78-adfbfe94c221 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:52.687537 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8c71-af61-478e-bb78-adfbfe94c221 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:52.687808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8c71-af61-478e-bb78-adfbfe94c221 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:52.689580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 729/1474] 10.222.0.90 () {54 vars in 962 bytes} [Wed Feb 16 09:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:52.694183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa224059-825c-4ee0-807f-4f6bfac849ea None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:52.694476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa224059-825c-4ee0-807f-4f6bfac849ea None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:52.694755 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa224059-825c-4ee0-807f-4f6bfac849ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:52.713878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-fa224059-825c-4ee0-807f-4f6bfac849ea None None] MFA Rules not processed for user `5074090dca0b4a49b54dc252a5dd9420`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:52.715059 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fa224059-825c-4ee0-807f-4f6bfac849ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:52.721550 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 746/1475] 10.222.0.90 () {58 vars in 1059 bytes} [Wed Feb 16 09:21:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:52.729419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8c71-af61-478e-bb78-adfbfe94c221 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:52.742038 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8c71-af61-478e-bb78-adfbfe94c221 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:52.746560 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471f35f-8350-4163-b3e4-e3cfdfdbddb1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5074090dca0b4a49b54dc252a5dd9420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:52.747189 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471f35f-8350-4163-b3e4-e3cfdfdbddb1 service glance] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:52.747471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471f35f-8350-4163-b3e4-e3cfdfdbddb1 service glance] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:52.747746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471f35f-8350-4163-b3e4-e3cfdfdbddb1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:52.756940 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471f35f-8350-4163-b3e4-e3cfdfdbddb1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:52.758474 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471f35f-8350-4163-b3e4-e3cfdfdbddb1 service glance] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:52.767742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 730/1476] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:21:55.182010 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa968dd-8612-42d3-9150-9201a4013226 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:55.182585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa968dd-8612-42d3-9150-9201a4013226 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:55.182585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa968dd-8612-42d3-9150-9201a4013226 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:55.184392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 747/1477] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:21:55.189597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732637f1-490d-493d-a3f2-46409d879e46 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:55.190052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732637f1-490d-493d-a3f2-46409d879e46 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:55.190166 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732637f1-490d-493d-a3f2-46409d879e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:55.208553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-732637f1-490d-493d-a3f2-46409d879e46 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:55.209731 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-732637f1-490d-493d-a3f2-46409d879e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:55.218601 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 731/1478] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:21:55.241828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa968dd-8612-42d3-9150-9201a4013226 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:55.254147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa968dd-8612-42d3-9150-9201a4013226 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:55.259317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bb290-caaa-444d-a9ce-f7f974b11e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:55.260009 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb290-caaa-444d-a9ce-f7f974b11e3e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:55.260346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb290-caaa-444d-a9ce-f7f974b11e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:55.260623 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb290-caaa-444d-a9ce-f7f974b11e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:55.261346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bb290-caaa-444d-a9ce-f7f974b11e3e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:55.263186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bb290-caaa-444d-a9ce-f7f974b11e3e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:55.282911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 748/1479] 10.222.0.90 () {56 vars in 1108 bytes} [Wed Feb 16 09:21:55 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:21:57.632468 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9735b-7e45-4a92-9494-1dcd77cd22e9 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:57.633049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9735b-7e45-4a92-9494-1dcd77cd22e9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:57.633049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9735b-7e45-4a92-9494-1dcd77cd22e9 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:57.635290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 732/1480] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:21:57.640640 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6d0f-bf02-4cf0-9ec9-b8784abc9484 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:57.641071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6d0f-bf02-4cf0-9ec9-b8784abc9484 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:57.641205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a6d0f-bf02-4cf0-9ec9-b8784abc9484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:57.659830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6a3a6d0f-bf02-4cf0-9ec9-b8784abc9484 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:21:57.661051 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6a3a6d0f-bf02-4cf0-9ec9-b8784abc9484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:21:57.669615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 749/1481] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:21:57.710738 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9735b-7e45-4a92-9494-1dcd77cd22e9 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:21:57.725203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d9735b-7e45-4a92-9494-1dcd77cd22e9 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:21:57.731130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefc2a4-ae7a-4f90-a629-26ccc14a6ef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:21:57.731750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefc2a4-ae7a-4f90-a629-26ccc14a6ef4 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:21:57.732044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefc2a4-ae7a-4f90-a629-26ccc14a6ef4 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:21:57.732334 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefc2a4-ae7a-4f90-a629-26ccc14a6ef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:21:57.740405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefc2a4-ae7a-4f90-a629-26ccc14a6ef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:21:57.742010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefc2a4-ae7a-4f90-a629-26ccc14a6ef4 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:21:57.752707 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 733/1482] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:22:00.229174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f599688-0372-44dd-b1d6-51dc8b4de15c None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:22:00.229722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f599688-0372-44dd-b1d6-51dc8b4de15c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:22:00.229830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f599688-0372-44dd-b1d6-51dc8b4de15c None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:22:00.231521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 750/1483] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:22:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:22:00.236782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bd41a-e4c8-45a5-a92a-c6d55122f7eb None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:22:00.237221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bd41a-e4c8-45a5-a92a-c6d55122f7eb None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:22:00.237337 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bd41a-e4c8-45a5-a92a-c6d55122f7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:22:00.255258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-627bd41a-e4c8-45a5-a92a-c6d55122f7eb None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:22:00.256468 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-627bd41a-e4c8-45a5-a92a-c6d55122f7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:22:00.264200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 734/1484] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:22:00.301101 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f599688-0372-44dd-b1d6-51dc8b4de15c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:22:00.312797 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f599688-0372-44dd-b1d6-51dc8b4de15c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:22:00.316301 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a5f31-24eb-4999-bd15-0e0a9fe299d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:22:00.316923 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a5f31-24eb-4999-bd15-0e0a9fe299d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:22:00.317203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a5f31-24eb-4999-bd15-0e0a9fe299d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:22:00.317476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a5f31-24eb-4999-bd15-0e0a9fe299d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:22:00.326696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a5f31-24eb-4999-bd15-0e0a9fe299d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:22:00.328156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a5f31-24eb-4999-bd15-0e0a9fe299d9 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:22:00.337626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 751/1485] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:22:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:22:02.705421 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e7155-788a-4bc7-9d97-88e294c164ed None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:22:02.706010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e7155-788a-4bc7-9d97-88e294c164ed None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:22:02.706010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e7155-788a-4bc7-9d97-88e294c164ed None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:22:02.707822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 735/1486] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:22:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:22:02.713567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c07e-a5ab-4914-bb8b-87d4fe76be74 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:22:02.714004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c07e-a5ab-4914-bb8b-87d4fe76be74 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:22:02.714097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c07e-a5ab-4914-bb8b-87d4fe76be74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:22:02.731324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2502c07e-a5ab-4914-bb8b-87d4fe76be74 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:22:02.732793 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2502c07e-a5ab-4914-bb8b-87d4fe76be74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:22:02.740392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 752/1487] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:22:02.779158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e7155-788a-4bc7-9d97-88e294c164ed None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:22:02.789753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e7155-788a-4bc7-9d97-88e294c164ed None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:22:02.793210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6631310-f41c-4fcd-82b0-e3649fba2143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:22:02.793828 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6631310-f41c-4fcd-82b0-e3649fba2143 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:22:02.794106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6631310-f41c-4fcd-82b0-e3649fba2143 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:22:02.794382 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6631310-f41c-4fcd-82b0-e3649fba2143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:22:02.802989 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6631310-f41c-4fcd-82b0-e3649fba2143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:22:02.804442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6631310-f41c-4fcd-82b0-e3649fba2143 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:22:02.814324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 736/1488] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:22:05.310464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ebe7e-4435-4652-8653-b15ef9d4c1c4 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:22:05.311004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ebe7e-4435-4652-8653-b15ef9d4c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:22:05.311004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ebe7e-4435-4652-8653-b15ef9d4c1c4 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:22:05.312736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 753/1489] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:22:05.317913 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaacfd-08d9-4357-bf04-4d2a503d81f3 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:22:05.318324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaacfd-08d9-4357-bf04-4d2a503d81f3 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:22:05.318685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaacfd-08d9-4357-bf04-4d2a503d81f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:22:05.336963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0ddaacfd-08d9-4357-bf04-4d2a503d81f3 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:22:05.338123 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0ddaacfd-08d9-4357-bf04-4d2a503d81f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:22:05.345710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 737/1490] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:22:05.386342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ebe7e-4435-4652-8653-b15ef9d4c1c4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:22:05.396613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ebe7e-4435-4652-8653-b15ef9d4c1c4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:22:05.400544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdc9a3-5d30-47db-8049-ec591b2b0a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:22:05.401156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdc9a3-5d30-47db-8049-ec591b2b0a99 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:22:05.401434 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdc9a3-5d30-47db-8049-ec591b2b0a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:22:05.401705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdc9a3-5d30-47db-8049-ec591b2b0a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:22:05.410144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdc9a3-5d30-47db-8049-ec591b2b0a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:22:05.411566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdc9a3-5d30-47db-8049-ec591b2b0a99 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:22:05.421130 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 754/1491] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:22:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:22:07.922389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e9db-922b-4d6f-b655-d98d69a430a2 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:22:07.922971 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e9db-922b-4d6f-b655-d98d69a430a2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:22:07.922971 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e9db-922b-4d6f-b655-d98d69a430a2 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:22:07.924738 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 738/1492] 10.222.0.90 () {54 vars in 926 bytes} [Wed Feb 16 09:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:22:07.930454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecce9f-5271-4cc4-afd1-7bac58250f87 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:22:07.930874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecce9f-5271-4cc4-afd1-7bac58250f87 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:22:07.931008 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecce9f-5271-4cc4-afd1-7bac58250f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:22:07.948848 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5eecce9f-5271-4cc4-afd1-7bac58250f87 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:22:07.950025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5eecce9f-5271-4cc4-afd1-7bac58250f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:22:07.957736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 755/1493] 10.222.0.90 () {58 vars in 1023 bytes} [Wed Feb 16 09:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:22:07.996201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e9db-922b-4d6f-b655-d98d69a430a2 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:22:08.006537 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e9db-922b-4d6f-b655-d98d69a430a2 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:22:08.010695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adedcd4-ad17-47be-8548-a970fef2ee16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:22:08.011334 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adedcd4-ad17-47be-8548-a970fef2ee16 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:22:08.011614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adedcd4-ad17-47be-8548-a970fef2ee16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:22:08.011890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adedcd4-ad17-47be-8548-a970fef2ee16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:22:08.021081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adedcd4-ad17-47be-8548-a970fef2ee16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:22:08.022526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adedcd4-ad17-47be-8548-a970fef2ee16 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:22:08.032870 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 739/1494] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:23:30.869243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b27388-2aee-49c4-b48a-feeebbff8467 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:30.869834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b27388-2aee-49c4-b48a-feeebbff8467 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:30.869946 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b27388-2aee-49c4-b48a-feeebbff8467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:30.889553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-75b27388-2aee-49c4-b48a-feeebbff8467 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:23:30.890722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-75b27388-2aee-49c4-b48a-feeebbff8467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:23:30.898764 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 756/1495] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:23:30.906816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2239282-2fb7-4b1a-bcf0-f12f9c1ae03f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:30.907319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2239282-2fb7-4b1a-bcf0-f12f9c1ae03f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:30.907422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2239282-2fb7-4b1a-bcf0-f12f9c1ae03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:30.926900 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-e2239282-2fb7-4b1a-bcf0-f12f9c1ae03f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:23:30.928425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e2239282-2fb7-4b1a-bcf0-f12f9c1ae03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:23:30.936066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 740/1496] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:23:30.940517 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b27388-2aee-49c4-b48a-feeebbff8467 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:23:30.949707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b27388-2aee-49c4-b48a-feeebbff8467 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:23:30.954433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd57348-f9d4-4f51-a408-e528e751330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:23:30.955073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd57348-f9d4-4f51-a408-e528e751330e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:30.955351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd57348-f9d4-4f51-a408-e528e751330e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:30.955645 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd57348-f9d4-4f51-a408-e528e751330e admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:30.956394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd57348-f9d4-4f51-a408-e528e751330e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:23:30.956703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd57348-f9d4-4f51-a408-e528e751330e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:23:30.958603 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd57348-f9d4-4f51-a408-e528e751330e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:23:30.969834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 757/1497] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:23:30.978390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2239282-2fb7-4b1a-bcf0-f12f9c1ae03f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:23:30.987328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2239282-2fb7-4b1a-bcf0-f12f9c1ae03f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:23:30.992625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c0d6-dcdb-4035-bd06-bd4eae41d7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:23:30.993269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c0d6-dcdb-4035-bd06-bd4eae41d7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:30.993553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c0d6-dcdb-4035-bd06-bd4eae41d7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:30.993829 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660c0d6-dcdb-4035-bd06-bd4eae41d7e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:30.994549 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660c0d6-dcdb-4035-bd06-bd4eae41d7e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:23:30.996490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660c0d6-dcdb-4035-bd06-bd4eae41d7e9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:23:31.030436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 741/1498] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:23:30 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:23:31.034667 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd57348-f9d4-4f51-a408-e528e751330e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:23:31.046361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd57348-f9d4-4f51-a408-e528e751330e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:23:31.100089 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963206b-5b08-4c64-a823-56624b441463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:23:31.100796 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963206b-5b08-4c64-a823-56624b441463 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:31.101074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963206b-5b08-4c64-a823-56624b441463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:31.101347 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963206b-5b08-4c64-a823-56624b441463 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:31.102015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963206b-5b08-4c64-a823-56624b441463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:23:31.103940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963206b-5b08-4c64-a823-56624b441463 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:23:31.123586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 758/1499] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:23:31 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:23:31.127786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c0d6-dcdb-4035-bd06-bd4eae41d7e9 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:23:31.138333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660c0d6-dcdb-4035-bd06-bd4eae41d7e9 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:23:31.143154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f3a20-0a9b-43f5-8fad-bb09d8852cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:23:31.143828 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f3a20-0a9b-43f5-8fad-bb09d8852cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:31.144141 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f3a20-0a9b-43f5-8fad-bb09d8852cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:31.144418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f3a20-0a9b-43f5-8fad-bb09d8852cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:31.145204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f3a20-0a9b-43f5-8fad-bb09d8852cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:23:31.146955 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f3a20-0a9b-43f5-8fad-bb09d8852cc1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:23:31.159604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 742/1500] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:23:31.164161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963206b-5b08-4c64-a823-56624b441463 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:23:31.173648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963206b-5b08-4c64-a823-56624b441463 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:23:31.178865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed569a-597a-462a-9d85-c4fd30582673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:23:31.179523 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed569a-597a-462a-9d85-c4fd30582673 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:31.179788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed569a-597a-462a-9d85-c4fd30582673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:31.180093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed569a-597a-462a-9d85-c4fd30582673 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:31.180813 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed569a-597a-462a-9d85-c4fd30582673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:23:31.182384 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed569a-597a-462a-9d85-c4fd30582673 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:23:31.196574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 759/1501] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:23:31.200816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f3a20-0a9b-43f5-8fad-bb09d8852cc1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:23:31.210980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f3a20-0a9b-43f5-8fad-bb09d8852cc1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:23:31.215448 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05158e8d-b933-4899-8544-2c6704bacfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:23:31.216351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05158e8d-b933-4899-8544-2c6704bacfff admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:31.216633 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05158e8d-b933-4899-8544-2c6704bacfff admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:31.216907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05158e8d-b933-4899-8544-2c6704bacfff admin admin] PATH_INFO: `/v3/projects/9b9d7cd378ff48b6b6e67929b877ae4c/users/5329512ef9c44109885bbe9640897905/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:31.231913 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05158e8d-b933-4899-8544-2c6704bacfff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9d7cd378ff48b6b6e67929b877ae4c, user_id=5329512ef9c44109885bbe9640897905, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:23:31.234618 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05158e8d-b933-4899-8544-2c6704bacfff admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:23:31.247998 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 743/1502] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:23:31 2022] PUT /identity/v3/projects/9b9d7cd378ff48b6b6e67929b877ae4c/users/5329512ef9c44109885bbe9640897905/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:23:31.261098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f93b8a-793c-40d8-8ba8-e575f20ec357 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:31.261529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f93b8a-793c-40d8-8ba8-e575f20ec357 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:31.261805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f93b8a-793c-40d8-8ba8-e575f20ec357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:31.288586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-84f93b8a-793c-40d8-8ba8-e575f20ec357 None None] MFA Rules not processed for user `5329512ef9c44109885bbe9640897905`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:23:31.289765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-84f93b8a-793c-40d8-8ba8-e575f20ec357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:23:31.354678 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 760/1503] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:23:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:23:31.365959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05158e8d-b933-4899-8544-2c6704bacfff admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:23:31.445003 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05158e8d-b933-4899-8544-2c6704bacfff admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:23:31.452726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80874556-f2e1-497b-b2db-488ef6e2a0d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:23:31.453555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80874556-f2e1-497b-b2db-488ef6e2a0d0 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:31.454052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80874556-f2e1-497b-b2db-488ef6e2a0d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:31.454602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80874556-f2e1-497b-b2db-488ef6e2a0d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:31.469818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80874556-f2e1-497b-b2db-488ef6e2a0d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:23:31.472962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80874556-f2e1-497b-b2db-488ef6e2a0d0 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:23:31.484518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 744/1504] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:23:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:23:31.554453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5907623-c91a-4088-991a-218ffedd982d None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:31.554737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5907623-c91a-4088-991a-218ffedd982d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:31.555007 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5907623-c91a-4088-991a-218ffedd982d None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:31.556714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 761/1505] 10.222.0.90 () {52 vars in 829 bytes} [Wed Feb 16 09:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:23:31.560372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80874556-f2e1-497b-b2db-488ef6e2a0d0 service nova] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:23:31.618688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80874556-f2e1-497b-b2db-488ef6e2a0d0 service nova] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:23:31.623161 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:23:31.624006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:31.624304 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:31.624568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] PATH_INFO: `/v3/users/5329512ef9c44109885bbe9640897905` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:31.625719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5329512ef9c44109885bbe9640897905)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:23:31.626722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:23:31.626722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:23:31.626722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:23:31.627909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:23:31.692908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5329512ef9c44109885bbe9640897905'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:23:31.710978 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5329512ef9c44109885bbe9640897905'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:23:31.720122 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5329512ef9c44109885bbe9640897905'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:23:31.733002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5329512ef9c44109885bbe9640897905'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:23:31.733677 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5329512ef9c44109885bbe9640897905'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:23:31.740474 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 745/1506] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:23:31 2022] DELETE /identity/v3/users/5329512ef9c44109885bbe9640897905 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:23:31.744967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881920-41d1-4c0c-b6fe-cdc54ccb7dcb None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:31.745260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881920-41d1-4c0c-b6fe-cdc54ccb7dcb None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:31.745537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881920-41d1-4c0c-b6fe-cdc54ccb7dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:31.762369 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-21881920-41d1-4c0c-b6fe-cdc54ccb7dcb None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:23:31.763530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-21881920-41d1-4c0c-b6fe-cdc54ccb7dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:23:31.820974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 762/1507] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:23:31.832476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:23:31.834038 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:23:31.892225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eceb27-22a5-427c-88c8-7132cf19eee9 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:23:31.896000 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db359904-3ef9-460e-b68b-cb33066930e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:23:31.896733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db359904-3ef9-460e-b68b-cb33066930e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:31.897016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db359904-3ef9-460e-b68b-cb33066930e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:31.897562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db359904-3ef9-460e-b68b-cb33066930e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:31.906271 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db359904-3ef9-460e-b68b-cb33066930e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:23:31.907694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db359904-3ef9-460e-b68b-cb33066930e2 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:23:31.917338 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 746/1508] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:23:32.268906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881920-41d1-4c0c-b6fe-cdc54ccb7dcb None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:23:32.270897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-21881920-41d1-4c0c-b6fe-cdc54ccb7dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:23:32.283044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881920-41d1-4c0c-b6fe-cdc54ccb7dcb None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:23:32.289099 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:23:32.289950 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:23:32.290353 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:23:32.290501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] PATH_INFO: `/v3/projects/9b9d7cd378ff48b6b6e67929b877ae4c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:23:32.291799 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9d7cd378ff48b6b6e67929b877ae4c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:23:32.292969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:23:32.292969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:23:32.292969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:23:32.294203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:23:32.353719 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9d7cd378ff48b6b6e67929b877ae4c', 'request_id': 'req-e72b6771-447c-44b8-abf8-be337faf6cb7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:23:32.359465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9d7cd378ff48b6b6e67929b877ae4c', 'request_id': 'req-e72b6771-447c-44b8-abf8-be337faf6cb7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:23:32.372637 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9d7cd378ff48b6b6e67929b877ae4c', 'request_id': 'req-e72b6771-447c-44b8-abf8-be337faf6cb7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:23:32.387695 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] The token cache is being invalidate because project 9b9d7cd378ff48b6b6e67929b877ae4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:23:32.387983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:23:32.388739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e72b6771-447c-44b8-abf8-be337faf6cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:23:32.390302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 763/1509] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:23:32 2022] DELETE /identity/v3/projects/9b9d7cd378ff48b6b6e67929b877ae4c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:25:11.815804 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b23ee8-1c2c-4901-a28b-be6ce4dc9456 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:11.816455 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b23ee8-1c2c-4901-a28b-be6ce4dc9456 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:11.816569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b23ee8-1c2c-4901-a28b-be6ce4dc9456 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:11.818279 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 747/1510] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 09:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:25:11.823815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b164b2-99f6-4c92-b179-c8b3645d5795 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:11.824353 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b164b2-99f6-4c92-b179-c8b3645d5795 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:11.824841 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b164b2-99f6-4c92-b179-c8b3645d5795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:11.846877 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b1b164b2-99f6-4c92-b179-c8b3645d5795 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:25:11.848208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b1b164b2-99f6-4c92-b179-c8b3645d5795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:11.905809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 764/1511] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 09:25:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:25:12.065939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b23ee8-1c2c-4901-a28b-be6ce4dc9456 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:25:12.068046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-96b23ee8-1c2c-4901-a28b-be6ce4dc9456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:12.143751 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b23ee8-1c2c-4901-a28b-be6ce4dc9456 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:25:12.149789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702f515-77c3-4b0d-b334-9cacba5c5000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:25:12.150446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702f515-77c3-4b0d-b334-9cacba5c5000 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:12.150730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702f515-77c3-4b0d-b334-9cacba5c5000 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:12.151007 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702f515-77c3-4b0d-b334-9cacba5c5000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:12.161079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702f515-77c3-4b0d-b334-9cacba5c5000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:25:12.162677 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702f515-77c3-4b0d-b334-9cacba5c5000 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:25:12.172236 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 748/1512] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:25:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:25:12.231911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15372b-d018-4212-b264-c17a8b343322 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:12.232248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15372b-d018-4212-b264-c17a8b343322 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:12.232529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15372b-d018-4212-b264-c17a8b343322 None None] PATH_INFO: `/v3` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:12.233912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 765/1513] 10.222.0.24 () {54 vars in 925 bytes} [Wed Feb 16 09:25:12 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:25:12.240206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14403da1-7ff6-4038-8094-eaefddefeb1c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:12.240504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14403da1-7ff6-4038-8094-eaefddefeb1c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:12.240784 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14403da1-7ff6-4038-8094-eaefddefeb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:12.266291 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-14403da1-7ff6-4038-8094-eaefddefeb1c None None] MFA Rules not processed for user `7d870fbd90cb4fde9ceafd2b737795eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:25:12.268493 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-14403da1-7ff6-4038-8094-eaefddefeb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:12.340207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 749/1514] 10.222.0.24 () {58 vars in 1015 bytes} [Wed Feb 16 09:25:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:25:13.480181 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494903aa-95d5-4329-b84b-515c686c4df3 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:13.480766 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494903aa-95d5-4329-b84b-515c686c4df3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:13.480766 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494903aa-95d5-4329-b84b-515c686c4df3 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:13.482608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 766/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 09:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:25:13.487592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c947b-87a5-4ac5-9903-e3e3c64f5aaa None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:13.488192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c947b-87a5-4ac5-9903-e3e3c64f5aaa None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:13.488192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c947b-87a5-4ac5-9903-e3e3c64f5aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:13.506310 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-522c947b-87a5-4ac5-9903-e3e3c64f5aaa None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:25:13.507470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-522c947b-87a5-4ac5-9903-e3e3c64f5aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:13.515281 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 750/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 09:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:25:13.674002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494903aa-95d5-4329-b84b-515c686c4df3 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:25:13.687740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494903aa-95d5-4329-b84b-515c686c4df3 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:25:13.694911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fa043-0dc6-4c29-a405-7380571b6618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:25:13.695531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fa043-0dc6-4c29-a405-7380571b6618 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:13.695811 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fa043-0dc6-4c29-a405-7380571b6618 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:13.696116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fa043-0dc6-4c29-a405-7380571b6618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:13.703956 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fa043-0dc6-4c29-a405-7380571b6618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:25:13.706354 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fa043-0dc6-4c29-a405-7380571b6618 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:25:13.715740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 767/1517] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:25:16.322493 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67089c8e-30cd-44b5-8959-1691f00c9bfe None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:16.323055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67089c8e-30cd-44b5-8959-1691f00c9bfe None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:16.323055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67089c8e-30cd-44b5-8959-1691f00c9bfe None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:16.324976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 751/1518] 10.222.0.90 () {54 vars in 960 bytes} [Wed Feb 16 09:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:25:16.330226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6677be-4370-4675-896b-5e705ae632e9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:16.330697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6677be-4370-4675-896b-5e705ae632e9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:16.330808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6677be-4370-4675-896b-5e705ae632e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:16.349491 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4c6677be-4370-4675-896b-5e705ae632e9 None None] MFA Rules not processed for user `7d870fbd90cb4fde9ceafd2b737795eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:25:16.350671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4c6677be-4370-4675-896b-5e705ae632e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:16.359020 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 768/1519] 10.222.0.90 () {58 vars in 1057 bytes} [Wed Feb 16 09:25:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:25:16.366498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67089c8e-30cd-44b5-8959-1691f00c9bfe None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:25:16.379621 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67089c8e-30cd-44b5-8959-1691f00c9bfe None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:25:16.384555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55912ada-a4ac-47c0-8f77-6ba692589eaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d870fbd90cb4fde9ceafd2b737795eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:25:16.385167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912ada-a4ac-47c0-8f77-6ba692589eaa service placement] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:16.385445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912ada-a4ac-47c0-8f77-6ba692589eaa service placement] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:16.385716 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912ada-a4ac-47c0-8f77-6ba692589eaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:16.394746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55912ada-a4ac-47c0-8f77-6ba692589eaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:25:16.396368 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55912ada-a4ac-47c0-8f77-6ba692589eaa service placement] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:25:16.406459 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 752/1520] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:25:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:25:25.368862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd042e-ab59-4a53-9dc6-419531886e21 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:25.369415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd042e-ab59-4a53-9dc6-419531886e21 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:25.369415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd042e-ab59-4a53-9dc6-419531886e21 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:25.371183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 769/1521] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 09:25:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:25:25.377070 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0737dd-cc76-434d-9f46-8e70ca60e54f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:25.377553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0737dd-cc76-434d-9f46-8e70ca60e54f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:25.377662 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0737dd-cc76-434d-9f46-8e70ca60e54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:25.395295 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-2f0737dd-cc76-434d-9f46-8e70ca60e54f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:25:25.396504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2f0737dd-cc76-434d-9f46-8e70ca60e54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:25.404593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 753/1522] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 09:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:25:25.561622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd042e-ab59-4a53-9dc6-419531886e21 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:25:25.577245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd042e-ab59-4a53-9dc6-419531886e21 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:25:25.583072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d65b1-d54f-4a12-b0a8-9268f3ccb7bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:25:25.583691 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d65b1-d54f-4a12-b0a8-9268f3ccb7bb service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:25.583969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d65b1-d54f-4a12-b0a8-9268f3ccb7bb service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:25.584270 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d65b1-d54f-4a12-b0a8-9268f3ccb7bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:25.592814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d65b1-d54f-4a12-b0a8-9268f3ccb7bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:25:25.594455 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d65b1-d54f-4a12-b0a8-9268f3ccb7bb service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:25:25.616425 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 770/1523] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:25:26.936197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6620131-f508-4864-8362-133131dd54f1 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:26.936783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6620131-f508-4864-8362-133131dd54f1 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:26.936783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6620131-f508-4864-8362-133131dd54f1 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:26.938844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 754/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 09:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:25:26.943685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0cc2-c838-41e9-a7e8-cb34274e085d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:26.944138 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0cc2-c838-41e9-a7e8-cb34274e085d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:26.944265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0cc2-c838-41e9-a7e8-cb34274e085d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:26.962160 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-974d0cc2-c838-41e9-a7e8-cb34274e085d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:25:26.963341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-974d0cc2-c838-41e9-a7e8-cb34274e085d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:26.971574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 771/1525] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 09:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:25:27.124535 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6620131-f508-4864-8362-133131dd54f1 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:25:27.138899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6620131-f508-4864-8362-133131dd54f1 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:25:27.144890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fb564-4be8-4fd4-be31-13d9a5224e69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:25:27.145536 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fb564-4be8-4fd4-be31-13d9a5224e69 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:27.145812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fb564-4be8-4fd4-be31-13d9a5224e69 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:27.146081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fb564-4be8-4fd4-be31-13d9a5224e69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:27.154774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fb564-4be8-4fd4-be31-13d9a5224e69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:25:27.156370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185fb564-4be8-4fd4-be31-13d9a5224e69 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:25:27.165929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 755/1526] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:25:32.093117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c8f06-5cf4-463a-b5c5-a2e301baa942 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:32.093661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c8f06-5cf4-463a-b5c5-a2e301baa942 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:32.093661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c8f06-5cf4-463a-b5c5-a2e301baa942 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:32.095385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 772/1527] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:25:32.100681 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07320d-870a-4052-9b52-54dd795cd17a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:32.101106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07320d-870a-4052-9b52-54dd795cd17a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:32.101240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07320d-870a-4052-9b52-54dd795cd17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:32.119391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-ae07320d-870a-4052-9b52-54dd795cd17a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:25:32.120609 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ae07320d-870a-4052-9b52-54dd795cd17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:32.129134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 756/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:25:32.166839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c8f06-5cf4-463a-b5c5-a2e301baa942 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:25:32.168566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-798c8f06-5cf4-463a-b5c5-a2e301baa942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:32.225773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c8f06-5cf4-463a-b5c5-a2e301baa942 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:25:32.229377 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aa127-154a-4cc3-aac5-f8695947b1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:25:32.230005 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aa127-154a-4cc3-aac5-f8695947b1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:32.230282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aa127-154a-4cc3-aac5-f8695947b1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:32.230575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aa127-154a-4cc3-aac5-f8695947b1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:32.240241 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389aa127-154a-4cc3-aac5-f8695947b1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:25:32.241664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389aa127-154a-4cc3-aac5-f8695947b1f2 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:25:32.251237 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 773/1529] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:25:34.591684 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e400d-8b90-4e4c-93c9-219ca3bb20fa None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:34.592256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e400d-8b90-4e4c-93c9-219ca3bb20fa None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:34.592372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e400d-8b90-4e4c-93c9-219ca3bb20fa None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:34.594125 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 757/1530] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:25:34.599306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71e442-c019-4658-8a7f-8baf1ff21fec None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:34.599747 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71e442-c019-4658-8a7f-8baf1ff21fec None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:34.599852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71e442-c019-4658-8a7f-8baf1ff21fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:34.617637 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6c71e442-c019-4658-8a7f-8baf1ff21fec None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:25:34.618819 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6c71e442-c019-4658-8a7f-8baf1ff21fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:34.627043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 774/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:25:34.663770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e400d-8b90-4e4c-93c9-219ca3bb20fa None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:25:34.666318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-bf5e400d-8b90-4e4c-93c9-219ca3bb20fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:34.687709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e400d-8b90-4e4c-93c9-219ca3bb20fa None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:25:34.691599 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ab54a-0a91-4207-87a1-0ea873104f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:25:34.692261 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ab54a-0a91-4207-87a1-0ea873104f11 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:34.692545 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ab54a-0a91-4207-87a1-0ea873104f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:34.692818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ab54a-0a91-4207-87a1-0ea873104f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:34.701534 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ab54a-0a91-4207-87a1-0ea873104f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:25:34.702950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ab54a-0a91-4207-87a1-0ea873104f11 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:25:34.712378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 758/1532] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:25:39.259886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1599-c3fa-435b-ad1c-9b31283d8b2e None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:39.260503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1599-c3fa-435b-ad1c-9b31283d8b2e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:39.260503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1599-c3fa-435b-ad1c-9b31283d8b2e None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:39.262250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 775/1533] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:25:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:25:39.267721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87db0-0cb2-4e6e-bdd7-72bad3144fc3 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:39.268160 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87db0-0cb2-4e6e-bdd7-72bad3144fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:39.268255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87db0-0cb2-4e6e-bdd7-72bad3144fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:39.286794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-88d87db0-0cb2-4e6e-bdd7-72bad3144fc3 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:25:39.287968 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-88d87db0-0cb2-4e6e-bdd7-72bad3144fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:39.295667 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 759/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:25:39.556839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1599-c3fa-435b-ad1c-9b31283d8b2e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:25:39.558427 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4b4f1599-c3fa-435b-ad1c-9b31283d8b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:39.613817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1599-c3fa-435b-ad1c-9b31283d8b2e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:25:39.617340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc754eb-e35d-45c8-9bbb-9d0adb93d5b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:25:39.617967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc754eb-e35d-45c8-9bbb-9d0adb93d5b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:39.618248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc754eb-e35d-45c8-9bbb-9d0adb93d5b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:39.618521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc754eb-e35d-45c8-9bbb-9d0adb93d5b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:39.628150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc754eb-e35d-45c8-9bbb-9d0adb93d5b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:25:39.629571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc754eb-e35d-45c8-9bbb-9d0adb93d5b8 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:25:39.638725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 776/1535] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:25:41.967799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000c5f-7dc2-43b8-9fb0-70b57cbea2d7 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:41.968725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000c5f-7dc2-43b8-9fb0-70b57cbea2d7 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:41.968725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0000c5f-7dc2-43b8-9fb0-70b57cbea2d7 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:41.970201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 760/1536] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 09:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:25:41.975323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f8e9b-5f14-45d4-a145-aa8b8c004702 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:41.975775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f8e9b-5f14-45d4-a145-aa8b8c004702 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:41.975962 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f8e9b-5f14-45d4-a145-aa8b8c004702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:41.994164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-469f8e9b-5f14-45d4-a145-aa8b8c004702 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:25:41.995339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-469f8e9b-5f14-45d4-a145-aa8b8c004702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:42.003755 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 777/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 09:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:25:42.263039 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45183db-7a3f-428d-92b7-7e92269c614d None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:42.263244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45183db-7a3f-428d-92b7-7e92269c614d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:42.263507 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45183db-7a3f-428d-92b7-7e92269c614d None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:42.265311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 761/1538] 10.222.0.90 () {54 vars in 963 bytes} [Wed Feb 16 09:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:25:42.272542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a282-724c-4c7f-865c-3117e3c2051b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:42.272832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a282-724c-4c7f-865c-3117e3c2051b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:42.273372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a282-724c-4c7f-865c-3117e3c2051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:42.292221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2d00a282-724c-4c7f-865c-3117e3c2051b None None] MFA Rules not processed for user `96e6c68eee11421bbb6b4066a856f228`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:25:42.293411 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2d00a282-724c-4c7f-865c-3117e3c2051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:25:42.300473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 778/1539] 10.222.0.90 () {58 vars in 1060 bytes} [Wed Feb 16 09:25:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:25:42.308274 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45183db-7a3f-428d-92b7-7e92269c614d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:25:42.318758 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45183db-7a3f-428d-92b7-7e92269c614d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:25:42.322245 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0d15b-666a-4637-accb-7a24084d6c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:25:42.322866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0d15b-666a-4637-accb-7a24084d6c29 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:25:42.323152 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0d15b-666a-4637-accb-7a24084d6c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:25:42.323429 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0d15b-666a-4637-accb-7a24084d6c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:25:42.332341 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0d15b-666a-4637-accb-7a24084d6c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:25:42.333765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0d15b-666a-4637-accb-7a24084d6c29 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:25:42.343051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 762/1540] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:08.446205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4e490-4e6e-49ce-b16b-89d15b6abcfa None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:08.447209 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4e490-4e6e-49ce-b16b-89d15b6abcfa None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:08.447662 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4e490-4e6e-49ce-b16b-89d15b6abcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:08.475128 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-fbb4e490-4e6e-49ce-b16b-89d15b6abcfa None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:08.476655 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fbb4e490-4e6e-49ce-b16b-89d15b6abcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:08.485849 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 779/1541] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:08.494428 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c49b9-44da-4999-ace1-a2106cbd8fd3 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:08.494992 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c49b9-44da-4999-ace1-a2106cbd8fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:08.495258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c49b9-44da-4999-ace1-a2106cbd8fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:08.523951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-431c49b9-44da-4999-ace1-a2106cbd8fd3 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:08.525598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-431c49b9-44da-4999-ace1-a2106cbd8fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:08.537116 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 763/1542] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:08.541900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4e490-4e6e-49ce-b16b-89d15b6abcfa None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:08.554407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4e490-4e6e-49ce-b16b-89d15b6abcfa None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:08.564700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0837a8-2fa7-4790-81a4-3ae2ceac82c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:08.565731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0837a8-2fa7-4790-81a4-3ae2ceac82c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:08.566194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0837a8-2fa7-4790-81a4-3ae2ceac82c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:08.566647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0837a8-2fa7-4790-81a4-3ae2ceac82c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:08.567593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0837a8-2fa7-4790-81a4-3ae2ceac82c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:08.568217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0837a8-2fa7-4790-81a4-3ae2ceac82c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:08.569992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0837a8-2fa7-4790-81a4-3ae2ceac82c4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:08.589743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 780/1543] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:08.598345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c49b9-44da-4999-ace1-a2106cbd8fd3 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:08.613710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c49b9-44da-4999-ace1-a2106cbd8fd3 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:08.623963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e773633-e1e5-4bc7-b0f0-ec013f9ed7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:08.624653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773633-e1e5-4bc7-b0f0-ec013f9ed7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:08.624934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773633-e1e5-4bc7-b0f0-ec013f9ed7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:08.625753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773633-e1e5-4bc7-b0f0-ec013f9ed7c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:08.626446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e773633-e1e5-4bc7-b0f0-ec013f9ed7c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:08.630272 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e773633-e1e5-4bc7-b0f0-ec013f9ed7c0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:08.682699 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 764/1544] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:08 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:08.686823 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0837a8-2fa7-4790-81a4-3ae2ceac82c4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:08.702599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0837a8-2fa7-4790-81a4-3ae2ceac82c4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:08.772784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d941d-ad59-4d76-946d-0cb2c64e844d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:08.773867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d941d-ad59-4d76-946d-0cb2c64e844d admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:08.774789 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d941d-ad59-4d76-946d-0cb2c64e844d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:08.775289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d941d-ad59-4d76-946d-0cb2c64e844d admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:08.776231 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d941d-ad59-4d76-946d-0cb2c64e844d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:08.778381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d941d-ad59-4d76-946d-0cb2c64e844d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:08.824333 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 781/1545] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:08 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:08.829472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e773633-e1e5-4bc7-b0f0-ec013f9ed7c0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:08.846809 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e773633-e1e5-4bc7-b0f0-ec013f9ed7c0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:08.856348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00d764-4614-4ce3-abac-a2b8baa7a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:08.857022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00d764-4614-4ce3-abac-a2b8baa7a37e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:08.857424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00d764-4614-4ce3-abac-a2b8baa7a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:08.857699 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00d764-4614-4ce3-abac-a2b8baa7a37e admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:08.858416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00d764-4614-4ce3-abac-a2b8baa7a37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:08.860590 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00d764-4614-4ce3-abac-a2b8baa7a37e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:08.876816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 765/1546] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:08.881115 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d941d-ad59-4d76-946d-0cb2c64e844d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:08.892378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d941d-ad59-4d76-946d-0cb2c64e844d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:08.901886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797b4af-d244-4f9f-b9e1-e65c5a0e90eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:08.902855 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797b4af-d244-4f9f-b9e1-e65c5a0e90eb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:08.903363 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797b4af-d244-4f9f-b9e1-e65c5a0e90eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:08.903891 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797b4af-d244-4f9f-b9e1-e65c5a0e90eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:08.904872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797b4af-d244-4f9f-b9e1-e65c5a0e90eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:08.906829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797b4af-d244-4f9f-b9e1-e65c5a0e90eb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:08.918801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 782/1547] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:08.923794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00d764-4614-4ce3-abac-a2b8baa7a37e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:08.939448 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00d764-4614-4ce3-abac-a2b8baa7a37e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:08.947801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bda70-e43e-49f4-937d-3a8faceb07f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:08.948837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bda70-e43e-49f4-937d-3a8faceb07f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:08.949120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bda70-e43e-49f4-937d-3a8faceb07f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:08.949387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bda70-e43e-49f4-937d-3a8faceb07f1 admin admin] PATH_INFO: `/v3/projects/378d921e0ecd4ac787e28c9a159919af/users/66b7273bafec493c86170c076bafe756/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:08.971785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bda70-e43e-49f4-937d-3a8faceb07f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378d921e0ecd4ac787e28c9a159919af, user_id=66b7273bafec493c86170c076bafe756, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:08.974550 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bda70-e43e-49f4-937d-3a8faceb07f1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.005954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 766/1548] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:08 2022] PUT /identity/v3/projects/378d921e0ecd4ac787e28c9a159919af/users/66b7273bafec493c86170c076bafe756/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:09.029978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a6ffb-72d8-4013-948a-3eaf369d0fcc None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.030644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a6ffb-72d8-4013-948a-3eaf369d0fcc None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.031165 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a6ffb-72d8-4013-948a-3eaf369d0fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.076684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-699a6ffb-72d8-4013-948a-3eaf369d0fcc None None] MFA Rules not processed for user `66b7273bafec493c86170c076bafe756`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.078867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-699a6ffb-72d8-4013-948a-3eaf369d0fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.176729 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 783/1549] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.181996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bda70-e43e-49f4-937d-3a8faceb07f1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.270586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bda70-e43e-49f4-937d-3a8faceb07f1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.274712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f283d-b23f-449b-b00f-d487ea27223c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.275271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f283d-b23f-449b-b00f-d487ea27223c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.275776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f283d-b23f-449b-b00f-d487ea27223c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.275904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d7812-dfc8-47b2-bdac-40048cd1ca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.276539 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d7812-dfc8-47b2-bdac-40048cd1ca32 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.276967 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d7812-dfc8-47b2-bdac-40048cd1ca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.277244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d7812-dfc8-47b2-bdac-40048cd1ca32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.277929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d7812-dfc8-47b2-bdac-40048cd1ca32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.283443 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d7812-dfc8-47b2-bdac-40048cd1ca32 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.313892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b75f283d-b23f-449b-b00f-d487ea27223c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.315241 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b75f283d-b23f-449b-b00f-d487ea27223c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.323961 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 784/1550] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:09.325418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfad41-c165-4cf6-8b44-54f4aa56cb74 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.325777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfad41-c165-4cf6-8b44-54f4aa56cb74 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.326090 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcfad41-c165-4cf6-8b44-54f4aa56cb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.339541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 767/1551] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:09.341227 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b19b4a-57ef-4138-a26e-1add32de4d5c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.341511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b19b4a-57ef-4138-a26e-1add32de4d5c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.341787 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b19b4a-57ef-4138-a26e-1add32de4d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.362376 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ddcfad41-c165-4cf6-8b44-54f4aa56cb74 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.363747 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ddcfad41-c165-4cf6-8b44-54f4aa56cb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.376388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-20b19b4a-57ef-4138-a26e-1add32de4d5c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.376388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-20b19b4a-57ef-4138-a26e-1add32de4d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.451226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 785/1552] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.451992 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 768/1553] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.452514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0da9dd-a49d-4434-b411-4651a30f4d7c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.452850 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0da9dd-a49d-4434-b411-4651a30f4d7c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.452979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b19b4a-57ef-4138-a26e-1add32de4d5c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.453926 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0da9dd-a49d-4434-b411-4651a30f4d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.465342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b19b4a-57ef-4138-a26e-1add32de4d5c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.470216 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00e734-8b97-49c6-9d20-028f373183b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.471033 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00e734-8b97-49c6-9d20-028f373183b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.471460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00e734-8b97-49c6-9d20-028f373183b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.471753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00e734-8b97-49c6-9d20-028f373183b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.472472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00e734-8b97-49c6-9d20-028f373183b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.474798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00e734-8b97-49c6-9d20-028f373183b3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.482909 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-da0da9dd-a49d-4434-b411-4651a30f4d7c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.484129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-da0da9dd-a49d-4434-b411-4651a30f4d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.494677 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 786/1554] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.498958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 769/1555] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/users => generated 294 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:09.499439 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebca57-1736-4cc0-a358-f2d5ba1f3a82 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.499639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebca57-1736-4cc0-a358-f2d5ba1f3a82 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.499872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebca57-1736-4cc0-a358-f2d5ba1f3a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.502940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3e1a7-a921-4514-963a-42e091217ef8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.503491 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3e1a7-a921-4514-963a-42e091217ef8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.503992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3e1a7-a921-4514-963a-42e091217ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.519516 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-eaebca57-1736-4cc0-a358-f2d5ba1f3a82 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.520988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-eaebca57-1736-4cc0-a358-f2d5ba1f3a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.529193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 770/1556] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.530488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbdefa-f21d-4d54-aa83-36518a4ddb8f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.530956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbdefa-f21d-4d54-aa83-36518a4ddb8f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.531082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-20c3e1a7-a921-4514-963a-42e091217ef8 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.531942 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbdefa-f21d-4d54-aa83-36518a4ddb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.533017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-20c3e1a7-a921-4514-963a-42e091217ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.541038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 787/1557] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.542345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b2b07-8554-4583-a486-e3079359f1fe None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.542814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b2b07-8554-4583-a486-e3079359f1fe None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.543100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b2b07-8554-4583-a486-e3079359f1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.550254 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-6efbdefa-f21d-4d54-aa83-36518a4ddb8f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.551692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6efbdefa-f21d-4d54-aa83-36518a4ddb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.559608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 771/1558] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.561350 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0e9b2b07-8554-4583-a486-e3079359f1fe None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.562574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0e9b2b07-8554-4583-a486-e3079359f1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.565815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444df23-da3e-4dda-ad2d-2845d4d4ce08 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.566277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444df23-da3e-4dda-ad2d-2845d4d4ce08 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.566897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444df23-da3e-4dda-ad2d-2845d4d4ce08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.570664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 788/1559] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.571418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b2b07-8554-4583-a486-e3079359f1fe None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.581561 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b2b07-8554-4583-a486-e3079359f1fe None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.586088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c8fe3-f9e9-41dd-aa62-f04280a63ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.586730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8fe3-f9e9-41dd-aa62-f04280a63ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.586935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-d444df23-da3e-4dda-ad2d-2845d4d4ce08 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.587041 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8fe3-f9e9-41dd-aa62-f04280a63ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.587276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8fe3-f9e9-41dd-aa62-f04280a63ce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.587988 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c8fe3-f9e9-41dd-aa62-f04280a63ce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:09.588185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d444df23-da3e-4dda-ad2d-2845d4d4ce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.588323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c8fe3-f9e9-41dd-aa62-f04280a63ce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.590017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c8fe3-f9e9-41dd-aa62-f04280a63ce8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.596114 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 772/1560] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.596891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444df23-da3e-4dda-ad2d-2845d4d4ce08 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.605541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 789/1561] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:09.605707 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444df23-da3e-4dda-ad2d-2845d4d4ce08 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.606859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2d6d-530d-4f3c-841f-b8dfef0be4cb None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.607152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2d6d-530d-4f3c-841f-b8dfef0be4cb None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.607430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2d6d-530d-4f3c-841f-b8dfef0be4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.615218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28459564-d711-4a54-b0d9-cc150b7e48cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.615951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28459564-d711-4a54-b0d9-cc150b7e48cf admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.616330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28459564-d711-4a54-b0d9-cc150b7e48cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.616598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28459564-d711-4a54-b0d9-cc150b7e48cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.617342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28459564-d711-4a54-b0d9-cc150b7e48cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.618924 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28459564-d711-4a54-b0d9-cc150b7e48cf admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.626350 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d08a2d6d-530d-4f3c-841f-b8dfef0be4cb None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.627520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d08a2d6d-530d-4f3c-841f-b8dfef0be4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.629717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 773/1562] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:09.633046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54197bc5-6256-4428-ade9-a3525e63d04f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.633046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54197bc5-6256-4428-ade9-a3525e63d04f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.633046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54197bc5-6256-4428-ade9-a3525e63d04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.638510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 790/1563] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.639831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24732a3-9fc1-4ad5-89af-c95be2ca1d25 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.640151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24732a3-9fc1-4ad5-89af-c95be2ca1d25 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.640426 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24732a3-9fc1-4ad5-89af-c95be2ca1d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.650388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-54197bc5-6256-4428-ade9-a3525e63d04f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.651601 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-54197bc5-6256-4428-ade9-a3525e63d04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.658525 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e24732a3-9fc1-4ad5-89af-c95be2ca1d25 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.659534 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 774/1564] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.659735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e24732a3-9fc1-4ad5-89af-c95be2ca1d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.660777 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b805a-cef5-4dc5-a3af-343a244dd8b9 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.661058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b805a-cef5-4dc5-a3af-343a244dd8b9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.661328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b805a-cef5-4dc5-a3af-343a244dd8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.667968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 791/1565] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.668830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24732a3-9fc1-4ad5-89af-c95be2ca1d25 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.678594 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24732a3-9fc1-4ad5-89af-c95be2ca1d25 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.681909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-8d8b805a-cef5-4dc5-a3af-343a244dd8b9 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.683065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8d8b805a-cef5-4dc5-a3af-343a244dd8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.683192 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c0ea7-9a1a-4e3b-b2fc-6b8a1679ed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.683871 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c0ea7-9a1a-4e3b-b2fc-6b8a1679ed75 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.684192 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c0ea7-9a1a-4e3b-b2fc-6b8a1679ed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.684463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c0ea7-9a1a-4e3b-b2fc-6b8a1679ed75 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.685177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c0ea7-9a1a-4e3b-b2fc-6b8a1679ed75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:09.685479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c0ea7-9a1a-4e3b-b2fc-6b8a1679ed75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.687084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c0ea7-9a1a-4e3b-b2fc-6b8a1679ed75 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.691528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 775/1566] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.692319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b805a-cef5-4dc5-a3af-343a244dd8b9 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.706328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 792/1567] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:09.706328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c0ea7-9a1a-4e3b-b2fc-6b8a1679ed75 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.706619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b805a-cef5-4dc5-a3af-343a244dd8b9 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.706619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417b106-d046-418d-b31e-4203352bf21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.706619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417b106-d046-418d-b31e-4203352bf21c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.706903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417b106-d046-418d-b31e-4203352bf21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.707042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417b106-d046-418d-b31e-4203352bf21c admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.707745 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417b106-d046-418d-b31e-4203352bf21c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:09.708068 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417b106-d046-418d-b31e-4203352bf21c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.709572 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c0ea7-9a1a-4e3b-b2fc-6b8a1679ed75 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.709693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417b106-d046-418d-b31e-4203352bf21c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.714187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf580f-2aa5-4d69-953c-b546d72b7ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.714802 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf580f-2aa5-4d69-953c-b546d72b7ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.715104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf580f-2aa5-4d69-953c-b546d72b7ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.715376 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf580f-2aa5-4d69-953c-b546d72b7ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.716073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf580f-2aa5-4d69-953c-b546d72b7ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.717939 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf580f-2aa5-4d69-953c-b546d72b7ab3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.723314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 776/1568] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:09.723314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417b106-d046-418d-b31e-4203352bf21c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.732370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417b106-d046-418d-b31e-4203352bf21c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.738642 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f8d0b-1849-4bf1-abfb-240b0a61069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.739556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f8d0b-1849-4bf1-abfb-240b0a61069e admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.739832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f8d0b-1849-4bf1-abfb-240b0a61069e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.740141 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f8d0b-1849-4bf1-abfb-240b0a61069e admin admin] PATH_INFO: `/v3/projects/1c74d657e9a84ec1b7d830019b23099b/users/7fa94d4d955d47a29c81eb9db0ff334f/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.744532 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 793/1569] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:09.745982 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa15d2-157f-4871-a521-eea1c4e40e38 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.746257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa15d2-157f-4871-a521-eea1c4e40e38 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.746530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa15d2-157f-4871-a521-eea1c4e40e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.755929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f8d0b-1849-4bf1-abfb-240b0a61069e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c74d657e9a84ec1b7d830019b23099b, user_id=7fa94d4d955d47a29c81eb9db0ff334f, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.758747 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f8d0b-1849-4bf1-abfb-240b0a61069e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.764863 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d9fa15d2-157f-4871-a521-eea1c4e40e38 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:09.766927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d9fa15d2-157f-4871-a521-eea1c4e40e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:09.772088 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 777/1570] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:09 2022] PUT /identity/v3/projects/1c74d657e9a84ec1b7d830019b23099b/users/7fa94d4d955d47a29c81eb9db0ff334f/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:09.775999 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f8d0b-1849-4bf1-abfb-240b0a61069e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.829347 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 794/1571] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:09.829347 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa15d2-157f-4871-a521-eea1c4e40e38 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.835602 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa15d2-157f-4871-a521-eea1c4e40e38 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.838502 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f8d0b-1849-4bf1-abfb-240b0a61069e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.840174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1cac0-f737-4bd7-9a6f-aaa27db033b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.840820 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1cac0-f737-4bd7-9a6f-aaa27db033b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.841102 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1cac0-f737-4bd7-9a6f-aaa27db033b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.841382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1cac0-f737-4bd7-9a6f-aaa27db033b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.842093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1cac0-f737-4bd7-9a6f-aaa27db033b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:09.842399 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1cac0-f737-4bd7-9a6f-aaa27db033b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.843374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d528b-bc3e-4ff8-8107-44d479554cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.844565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d528b-bc3e-4ff8-8107-44d479554cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.844757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1cac0-f737-4bd7-9a6f-aaa27db033b0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.844854 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d528b-bc3e-4ff8-8107-44d479554cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.845103 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d528b-bc3e-4ff8-8107-44d479554cf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.845890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d528b-bc3e-4ff8-8107-44d479554cf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:09.846195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d528b-bc3e-4ff8-8107-44d479554cf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.847781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d528b-bc3e-4ff8-8107-44d479554cf6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.856467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 795/1572] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:09.857349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1cac0-f737-4bd7-9a6f-aaa27db033b0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.859025 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 778/1573] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:09.860776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d528b-bc3e-4ff8-8107-44d479554cf6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.870260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d528b-bc3e-4ff8-8107-44d479554cf6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.875080 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d178d1-1544-4562-8710-12423a6da949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.875715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d178d1-1544-4562-8710-12423a6da949 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.875993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d178d1-1544-4562-8710-12423a6da949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.876305 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d178d1-1544-4562-8710-12423a6da949 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.876978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1cac0-f737-4bd7-9a6f-aaa27db033b0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.877092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d178d1-1544-4562-8710-12423a6da949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.878866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d178d1-1544-4562-8710-12423a6da949 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.883253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463c1d1-aaeb-462b-a38e-9a25f57c2886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.883892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c1d1-aaeb-462b-a38e-9a25f57c2886 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.884208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c1d1-aaeb-462b-a38e-9a25f57c2886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.884481 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463c1d1-aaeb-462b-a38e-9a25f57c2886 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.885216 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463c1d1-aaeb-462b-a38e-9a25f57c2886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:09.885521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463c1d1-aaeb-462b-a38e-9a25f57c2886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.887134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463c1d1-aaeb-462b-a38e-9a25f57c2886 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.899186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 796/1574] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:09.900250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463c1d1-aaeb-462b-a38e-9a25f57c2886 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.910144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463c1d1-aaeb-462b-a38e-9a25f57c2886 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.912012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 779/1575] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:09.912929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d178d1-1544-4562-8710-12423a6da949 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:09.965965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617086-0cdf-4461-8441-f260149baeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.966539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617086-0cdf-4461-8441-f260149baeac admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.966823 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617086-0cdf-4461-8441-f260149baeac admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.967093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617086-0cdf-4461-8441-f260149baeac admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.967767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66617086-0cdf-4461-8441-f260149baeac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.970351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66617086-0cdf-4461-8441-f260149baeac admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.974271 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d178d1-1544-4562-8710-12423a6da949 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:09.979100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae8227-8726-4f6e-9814-37d75e701a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:09.979762 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae8227-8726-4f6e-9814-37d75e701a51 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:09.980072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae8227-8726-4f6e-9814-37d75e701a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:09.980355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae8227-8726-4f6e-9814-37d75e701a51 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:09.981034 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae8227-8726-4f6e-9814-37d75e701a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:09.982993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ae8227-8726-4f6e-9814-37d75e701a51 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:09.995996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 797/1576] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:09.996865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617086-0cdf-4461-8441-f260149baeac admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.004915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 780/1577] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:09 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:10.005822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae8227-8726-4f6e-9814-37d75e701a51 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.015884 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae8227-8726-4f6e-9814-37d75e701a51 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.066460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617086-0cdf-4461-8441-f260149baeac admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.071726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319ca3e-1bd7-401b-83c0-29669610c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.072488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319ca3e-1bd7-401b-83c0-29669610c803 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.072768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319ca3e-1bd7-401b-83c0-29669610c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.073041 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319ca3e-1bd7-401b-83c0-29669610c803 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.073762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319ca3e-1bd7-401b-83c0-29669610c803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.075361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319ca3e-1bd7-401b-83c0-29669610c803 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.076916 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a57cc-3a41-495c-b2f6-e6d2e1ba7177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.077583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a57cc-3a41-495c-b2f6-e6d2e1ba7177 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.077864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a57cc-3a41-495c-b2f6-e6d2e1ba7177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.078238 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a57cc-3a41-495c-b2f6-e6d2e1ba7177 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.079082 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a57cc-3a41-495c-b2f6-e6d2e1ba7177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:10.080071 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a57cc-3a41-495c-b2f6-e6d2e1ba7177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.080963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a57cc-3a41-495c-b2f6-e6d2e1ba7177 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.088581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 798/1578] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.088581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319ca3e-1bd7-401b-83c0-29669610c803 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.092799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 781/1579] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:10.093546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a57cc-3a41-495c-b2f6-e6d2e1ba7177 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.102768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319ca3e-1bd7-401b-83c0-29669610c803 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.103525 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a57cc-3a41-495c-b2f6-e6d2e1ba7177 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.107548 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc701f74-4bb2-4fa8-b983-e94f22d70e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.107930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a62a31-aeb8-4908-b5f6-fe7ee873f54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.108232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc701f74-4bb2-4fa8-b983-e94f22d70e74 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.108517 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc701f74-4bb2-4fa8-b983-e94f22d70e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.108625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a62a31-aeb8-4908-b5f6-fe7ee873f54f admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.108795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc701f74-4bb2-4fa8-b983-e94f22d70e74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.108932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a62a31-aeb8-4908-b5f6-fe7ee873f54f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.109105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a62a31-aeb8-4908-b5f6-fe7ee873f54f admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.110298 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc701f74-4bb2-4fa8-b983-e94f22d70e74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.110431 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a62a31-aeb8-4908-b5f6-fe7ee873f54f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.112227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc701f74-4bb2-4fa8-b983-e94f22d70e74 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.112345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a62a31-aeb8-4908-b5f6-fe7ee873f54f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.139008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 782/1580] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:10 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:10.139474 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 799/1581] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:10 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:10.140307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc701f74-4bb2-4fa8-b983-e94f22d70e74 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.140508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a62a31-aeb8-4908-b5f6-fe7ee873f54f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.202881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a62a31-aeb8-4908-b5f6-fe7ee873f54f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.204096 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc701f74-4bb2-4fa8-b983-e94f22d70e74 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.208285 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a2b6e-d24f-493f-bc73-c43c3b7f6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.209040 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a2b6e-d24f-493f-bc73-c43c3b7f6939 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.209174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e61f6-5930-4d1d-b4d8-dbf723265b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.209299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a2b6e-d24f-493f-bc73-c43c3b7f6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.209484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a2b6e-d24f-493f-bc73-c43c3b7f6939 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.209761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e61f6-5930-4d1d-b4d8-dbf723265b87 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.210040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e61f6-5930-4d1d-b4d8-dbf723265b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.210313 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e61f6-5930-4d1d-b4d8-dbf723265b87 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.210408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a2b6e-d24f-493f-bc73-c43c3b7f6939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.210987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e61f6-5930-4d1d-b4d8-dbf723265b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.212319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a2b6e-d24f-493f-bc73-c43c3b7f6939 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.212901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e61f6-5930-4d1d-b4d8-dbf723265b87 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.234652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 800/1582] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:10 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:10.235350 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e61f6-5930-4d1d-b4d8-dbf723265b87 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.239354 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 783/1583] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:10 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:10.240471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a2b6e-d24f-493f-bc73-c43c3b7f6939 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.245533 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e61f6-5930-4d1d-b4d8-dbf723265b87 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.299482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778f8c6-a05e-429f-937f-ff02f8f95802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.300175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778f8c6-a05e-429f-937f-ff02f8f95802 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.300454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778f8c6-a05e-429f-937f-ff02f8f95802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.300724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778f8c6-a05e-429f-937f-ff02f8f95802 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.301399 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778f8c6-a05e-429f-937f-ff02f8f95802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.301637 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a2b6e-d24f-493f-bc73-c43c3b7f6939 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.303287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778f8c6-a05e-429f-937f-ff02f8f95802 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.306203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb185d97-29eb-4d4b-862e-f12ced0fe0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.306860 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb185d97-29eb-4d4b-862e-f12ced0fe0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.307142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb185d97-29eb-4d4b-862e-f12ced0fe0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.307417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb185d97-29eb-4d4b-862e-f12ced0fe0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.308163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb185d97-29eb-4d4b-862e-f12ced0fe0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.309746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb185d97-29eb-4d4b-862e-f12ced0fe0a5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.320416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 784/1584] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.321208 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb185d97-29eb-4d4b-862e-f12ced0fe0a5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.322376 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 801/1585] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:10 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:10.323490 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778f8c6-a05e-429f-937f-ff02f8f95802 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.331620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb185d97-29eb-4d4b-862e-f12ced0fe0a5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.336085 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94109f41-0461-4e9d-b611-8b02e977f876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.336252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778f8c6-a05e-429f-937f-ff02f8f95802 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.336949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94109f41-0461-4e9d-b611-8b02e977f876 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.337230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94109f41-0461-4e9d-b611-8b02e977f876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.337622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94109f41-0461-4e9d-b611-8b02e977f876 admin admin] PATH_INFO: `/v3/projects/1c74d657e9a84ec1b7d830019b23099b/users/7fa94d4d955d47a29c81eb9db0ff334f/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.339558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94109f41-0461-4e9d-b611-8b02e977f876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c74d657e9a84ec1b7d830019b23099b, user_id=7fa94d4d955d47a29c81eb9db0ff334f, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.340867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51c607-f7fb-40ec-8295-09e1e74659aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.341505 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51c607-f7fb-40ec-8295-09e1e74659aa admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.341792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51c607-f7fb-40ec-8295-09e1e74659aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.342067 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51c607-f7fb-40ec-8295-09e1e74659aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.342210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94109f41-0461-4e9d-b611-8b02e977f876 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.342743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51c607-f7fb-40ec-8295-09e1e74659aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.344925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51c607-f7fb-40ec-8295-09e1e74659aa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.353338 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 785/1586] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:10 2022] PUT /identity/v3/projects/1c74d657e9a84ec1b7d830019b23099b/users/7fa94d4d955d47a29c81eb9db0ff334f/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:10.354127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94109f41-0461-4e9d-b611-8b02e977f876 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.378589 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 802/1587] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:10 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:10.378589 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51c607-f7fb-40ec-8295-09e1e74659aa admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.421533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94109f41-0461-4e9d-b611-8b02e977f876 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.441575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51c607-f7fb-40ec-8295-09e1e74659aa admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.446524 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5706d-964d-4ba5-9ae5-11ee5e8c8005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.447347 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5706d-964d-4ba5-9ae5-11ee5e8c8005 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.447724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5706d-964d-4ba5-9ae5-11ee5e8c8005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.447998 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5706d-964d-4ba5-9ae5-11ee5e8c8005 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.448714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5706d-964d-4ba5-9ae5-11ee5e8c8005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.450670 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5706d-964d-4ba5-9ae5-11ee5e8c8005 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.471218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 803/1588] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:10 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:10.471938 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5706d-964d-4ba5-9ae5-11ee5e8c8005 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.482079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7692b7e-a014-4136-b4a7-207a684b6d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.482325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5706d-964d-4ba5-9ae5-11ee5e8c8005 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.482756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692b7e-a014-4136-b4a7-207a684b6d3f admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.483033 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692b7e-a014-4136-b4a7-207a684b6d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.483302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692b7e-a014-4136-b4a7-207a684b6d3f admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.484048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7692b7e-a014-4136-b4a7-207a684b6d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.486717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7692b7e-a014-4136-b4a7-207a684b6d3f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.487539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bcad4-d325-43e8-ad45-014688417e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.488226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bcad4-d325-43e8-ad45-014688417e7e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.488509 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bcad4-d325-43e8-ad45-014688417e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.488788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bcad4-d325-43e8-ad45-014688417e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.489662 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bcad4-d325-43e8-ad45-014688417e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.491236 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bcad4-d325-43e8-ad45-014688417e7e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.504216 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 804/1589] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.504216 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bcad4-d325-43e8-ad45-014688417e7e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.508068 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 786/1590] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:10 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:10.508658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7692b7e-a014-4136-b4a7-207a684b6d3f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.513828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bcad4-d325-43e8-ad45-014688417e7e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.518442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b92a35-d3c6-4dd0-859b-d90d55cfce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.519079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b92a35-d3c6-4dd0-859b-d90d55cfce38 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.519360 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b92a35-d3c6-4dd0-859b-d90d55cfce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.519562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7692b7e-a014-4136-b4a7-207a684b6d3f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.519673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b92a35-d3c6-4dd0-859b-d90d55cfce38 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.520334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b92a35-d3c6-4dd0-859b-d90d55cfce38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.522231 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b92a35-d3c6-4dd0-859b-d90d55cfce38 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.524002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a6869-e4f9-404d-9d43-006bcfd894f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.524930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6869-e4f9-404d-9d43-006bcfd894f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.525206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6869-e4f9-404d-9d43-006bcfd894f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.525480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6869-e4f9-404d-9d43-006bcfd894f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.526176 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a6869-e4f9-404d-9d43-006bcfd894f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.527761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a6869-e4f9-404d-9d43-006bcfd894f7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.538722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 787/1591] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.539792 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a6869-e4f9-404d-9d43-006bcfd894f7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.543292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 805/1592] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:10 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:10.544718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09628b-f845-40e6-9af7-15a857d790f5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.545000 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09628b-f845-40e6-9af7-15a857d790f5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.545277 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09628b-f845-40e6-9af7-15a857d790f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.550028 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a6869-e4f9-404d-9d43-006bcfd894f7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.554666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643f682-bd60-4c80-91ef-e2373249485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.555313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643f682-bd60-4c80-91ef-e2373249485b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.555602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643f682-bd60-4c80-91ef-e2373249485b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.555871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643f682-bd60-4c80-91ef-e2373249485b admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.556610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643f682-bd60-4c80-91ef-e2373249485b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.558193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643f682-bd60-4c80-91ef-e2373249485b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.568790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 788/1593] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.568958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643f682-bd60-4c80-91ef-e2373249485b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.571306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-3a09628b-f845-40e6-9af7-15a857d790f5 None None] MFA Rules not processed for user `7fa94d4d955d47a29c81eb9db0ff334f`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:10.572563 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3a09628b-f845-40e6-9af7-15a857d790f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:10.578061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643f682-bd60-4c80-91ef-e2373249485b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.583191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffbb7f-568d-4ae6-ac06-909995386d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.583824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffbb7f-568d-4ae6-ac06-909995386d32 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.584138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffbb7f-568d-4ae6-ac06-909995386d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.584419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffbb7f-568d-4ae6-ac06-909995386d32 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.585100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffbb7f-568d-4ae6-ac06-909995386d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.586982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffbb7f-568d-4ae6-ac06-909995386d32 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.606144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 789/1594] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:10 2022] POST /identity/v3/users => generated 294 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:10.606944 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffbb7f-568d-4ae6-ac06-909995386d32 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.616238 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffbb7f-568d-4ae6-ac06-909995386d32 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.620833 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6191e5-14a2-4c73-a08d-bd34b16409ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.621492 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6191e5-14a2-4c73-a08d-bd34b16409ca admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.621778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6191e5-14a2-4c73-a08d-bd34b16409ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.622055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6191e5-14a2-4c73-a08d-bd34b16409ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.622758 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6191e5-14a2-4c73-a08d-bd34b16409ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.624372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6191e5-14a2-4c73-a08d-bd34b16409ca admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.635195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 790/1595] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.635995 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6191e5-14a2-4c73-a08d-bd34b16409ca admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.639457 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 806/1596] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:10.640317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09628b-f845-40e6-9af7-15a857d790f5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.646074 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6191e5-14a2-4c73-a08d-bd34b16409ca admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.651299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4ec4f-8665-4ac9-8419-36763a35ff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.652000 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4ec4f-8665-4ac9-8419-36763a35ff10 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.652310 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4ec4f-8665-4ac9-8419-36763a35ff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.652685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4ec4f-8665-4ac9-8419-36763a35ff10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.653393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4ec4f-8665-4ac9-8419-36763a35ff10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.653513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09628b-f845-40e6-9af7-15a857d790f5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.655021 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4ec4f-8665-4ac9-8419-36763a35ff10 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.658515 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f470d2-bc39-4b62-bb55-bee834028756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.659171 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f470d2-bc39-4b62-bb55-bee834028756 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.659465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f470d2-bc39-4b62-bb55-bee834028756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.659724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f470d2-bc39-4b62-bb55-bee834028756 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.660471 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f470d2-bc39-4b62-bb55-bee834028756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.662036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f470d2-bc39-4b62-bb55-bee834028756 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.665949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 791/1597] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.669933 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4ec4f-8665-4ac9-8419-36763a35ff10 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.674669 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 807/1598] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.674669 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f470d2-bc39-4b62-bb55-bee834028756 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.679978 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4ec4f-8665-4ac9-8419-36763a35ff10 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.682054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f470d2-bc39-4b62-bb55-bee834028756 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.684765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a532d9-18b8-4596-8434-6fb6d78ea2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.685622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a532d9-18b8-4596-8434-6fb6d78ea2aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.685903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a532d9-18b8-4596-8434-6fb6d78ea2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.686180 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a532d9-18b8-4596-8434-6fb6d78ea2aa admin admin] PATH_INFO: `/v3/projects/7e491ed94c27421d8033572221092bbd/users/ff9ca3b6201b4f5780ccb309dc0440c7/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.686584 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263793e-2447-43fb-a3dd-ab8f3c89e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.687198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263793e-2447-43fb-a3dd-ab8f3c89e85f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.688039 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263793e-2447-43fb-a3dd-ab8f3c89e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.688438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263793e-2447-43fb-a3dd-ab8f3c89e85f admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.689239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263793e-2447-43fb-a3dd-ab8f3c89e85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.690801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263793e-2447-43fb-a3dd-ab8f3c89e85f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.700318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 808/1599] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.701044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a532d9-18b8-4596-8434-6fb6d78ea2aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e491ed94c27421d8033572221092bbd, user_id=ff9ca3b6201b4f5780ccb309dc0440c7, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.701153 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263793e-2447-43fb-a3dd-ab8f3c89e85f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.703935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a532d9-18b8-4596-8434-6fb6d78ea2aa admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.712386 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263793e-2447-43fb-a3dd-ab8f3c89e85f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.717984 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 792/1600] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:10 2022] PUT /identity/v3/projects/7e491ed94c27421d8033572221092bbd/users/ff9ca3b6201b4f5780ccb309dc0440c7/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:10.718595 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a532d9-18b8-4596-8434-6fb6d78ea2aa admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.777398 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e811-3e1b-4f31-ae2f-beb82fe9587d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.777972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e811-3e1b-4f31-ae2f-beb82fe9587d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.778250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e811-3e1b-4f31-ae2f-beb82fe9587d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.778522 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678e811-3e1b-4f31-ae2f-beb82fe9587d admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.779325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678e811-3e1b-4f31-ae2f-beb82fe9587d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.780942 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678e811-3e1b-4f31-ae2f-beb82fe9587d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.783165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a532d9-18b8-4596-8434-6fb6d78ea2aa admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.787797 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003997ef-b79e-42fe-8aa1-e5741f877889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.788488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003997ef-b79e-42fe-8aa1-e5741f877889 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.788774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003997ef-b79e-42fe-8aa1-e5741f877889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.789053 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003997ef-b79e-42fe-8aa1-e5741f877889 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.789770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003997ef-b79e-42fe-8aa1-e5741f877889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.791359 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 809/1601] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.791484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003997ef-b79e-42fe-8aa1-e5741f877889 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.791971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e811-3e1b-4f31-ae2f-beb82fe9587d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.801700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678e811-3e1b-4f31-ae2f-beb82fe9587d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.802182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 793/1602] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.803006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003997ef-b79e-42fe-8aa1-e5741f877889 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.806401 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65dcc3-5c83-46bf-8a7b-56f9a48ef2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.807038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65dcc3-5c83-46bf-8a7b-56f9a48ef2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.807315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65dcc3-5c83-46bf-8a7b-56f9a48ef2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.807586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65dcc3-5c83-46bf-8a7b-56f9a48ef2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.808317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65dcc3-5c83-46bf-8a7b-56f9a48ef2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.809885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65dcc3-5c83-46bf-8a7b-56f9a48ef2e4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.820793 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 810/1603] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.821969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65dcc3-5c83-46bf-8a7b-56f9a48ef2e4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.831695 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65dcc3-5c83-46bf-8a7b-56f9a48ef2e4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.836382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d314a-82c4-49fd-ae41-1136ae317805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.837237 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d314a-82c4-49fd-ae41-1136ae317805 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.837520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d314a-82c4-49fd-ae41-1136ae317805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.837798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d314a-82c4-49fd-ae41-1136ae317805 admin admin] PATH_INFO: `/v3/projects/cce33e1c7dcf4526a346c95b806cca92/users/6942b2411146441686440554bdaccf51/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.852680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d314a-82c4-49fd-ae41-1136ae317805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce33e1c7dcf4526a346c95b806cca92, user_id=6942b2411146441686440554bdaccf51, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.855323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d314a-82c4-49fd-ae41-1136ae317805 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.855665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003997ef-b79e-42fe-8aa1-e5741f877889 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.859331 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcbee0-f70a-4227-b0b7-3d4aeef579ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.860482 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcbee0-f70a-4227-b0b7-3d4aeef579ad service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.860768 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcbee0-f70a-4227-b0b7-3d4aeef579ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.861187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcbee0-f70a-4227-b0b7-3d4aeef579ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.868301 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 811/1604] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:10 2022] PUT /identity/v3/projects/cce33e1c7dcf4526a346c95b806cca92/users/6942b2411146441686440554bdaccf51/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:10.869088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d314a-82c4-49fd-ae41-1136ae317805 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.916326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcbee0-f70a-4227-b0b7-3d4aeef579ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.917786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcbee0-f70a-4227-b0b7-3d4aeef579ad service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.926606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 794/1605] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:10.927433 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcbee0-f70a-4227-b0b7-3d4aeef579ad service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.938613 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcbee0-f70a-4227-b0b7-3d4aeef579ad service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.939003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d314a-82c4-49fd-ae41-1136ae317805 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.943062 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74878fe4-3585-4405-9076-7d967783c503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.943718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74878fe4-3585-4405-9076-7d967783c503 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.943899 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07061698-581a-4e34-981a-dd420c375c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.944060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74878fe4-3585-4405-9076-7d967783c503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.944297 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74878fe4-3585-4405-9076-7d967783c503 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.944584 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061698-581a-4e34-981a-dd420c375c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.944854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061698-581a-4e34-981a-dd420c375c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.945032 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74878fe4-3585-4405-9076-7d967783c503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.945129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07061698-581a-4e34-981a-dd420c375c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.945839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07061698-581a-4e34-981a-dd420c375c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:10.946585 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74878fe4-3585-4405-9076-7d967783c503 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.947416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07061698-581a-4e34-981a-dd420c375c90 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:10.960586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 795/1606] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.960792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 812/1607] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:10.960792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcda48-ae3c-4b78-b9ab-3d7ffa4b0e7d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.960792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcda48-ae3c-4b78-b9ab-3d7ffa4b0e7d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.960792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcda48-ae3c-4b78-b9ab-3d7ffa4b0e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.962437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74878fe4-3585-4405-9076-7d967783c503 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.973022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74878fe4-3585-4405-9076-7d967783c503 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:10.977415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c3dcda48-ae3c-4b78-b9ab-3d7ffa4b0e7d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:10.978217 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495ca21-3f8e-49c1-b568-fda81cbb9b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:10.978583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c3dcda48-ae3c-4b78-b9ab-3d7ffa4b0e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:10.979563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495ca21-3f8e-49c1-b568-fda81cbb9b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:10.980218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495ca21-3f8e-49c1-b568-fda81cbb9b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:10.980750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495ca21-3f8e-49c1-b568-fda81cbb9b9f admin admin] PATH_INFO: `/v3/projects/e5ffe873ea8e4496ae33e277307e3b5b/users/53dc4402074b44deb42d688bc302a58c/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:10.988106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 813/1608] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:10.988741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcda48-ae3c-4b78-b9ab-3d7ffa4b0e7d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:10.998974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dcda48-ae3c-4b78-b9ab-3d7ffa4b0e7d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:11.000935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495ca21-3f8e-49c1-b568-fda81cbb9b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ffe873ea8e4496ae33e277307e3b5b, user_id=53dc4402074b44deb42d688bc302a58c, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:11.003679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495ca21-3f8e-49c1-b568-fda81cbb9b9f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:11.005644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b32a7-9dd7-4020-a65b-27f86bb8112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:11.006306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b32a7-9dd7-4020-a65b-27f86bb8112b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.006728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b32a7-9dd7-4020-a65b-27f86bb8112b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.007051 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b32a7-9dd7-4020-a65b-27f86bb8112b admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.007903 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b32a7-9dd7-4020-a65b-27f86bb8112b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:11.009813 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b32a7-9dd7-4020-a65b-27f86bb8112b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:11.021591 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 814/1609] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:11.022395 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b32a7-9dd7-4020-a65b-27f86bb8112b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:11.022629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 796/1610] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:10 2022] PUT /identity/v3/projects/e5ffe873ea8e4496ae33e277307e3b5b/users/53dc4402074b44deb42d688bc302a58c/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:11.024181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5c156-5b2f-4e1d-8ef2-570ffe519ac2 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.024915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5c156-5b2f-4e1d-8ef2-570ffe519ac2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.025197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5c156-5b2f-4e1d-8ef2-570ffe519ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.041244 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b32a7-9dd7-4020-a65b-27f86bb8112b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:11.053509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-5fe5c156-5b2f-4e1d-8ef2-570ffe519ac2 None None] MFA Rules not processed for user `6942b2411146441686440554bdaccf51`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:11.054724 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-5fe5c156-5b2f-4e1d-8ef2-570ffe519ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:11.099861 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c398f79-7fc8-46e1-b90d-2f5b3821b31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:11.100789 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c398f79-7fc8-46e1-b90d-2f5b3821b31a admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.101306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c398f79-7fc8-46e1-b90d-2f5b3821b31a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.101423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c398f79-7fc8-46e1-b90d-2f5b3821b31a admin admin] PATH_INFO: `/v3/projects/8b8af4daf82a43db88622613dfab613c/users/bc791ed3513e4bc39bfbe6711147ea59/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.118760 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c398f79-7fc8-46e1-b90d-2f5b3821b31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8af4daf82a43db88622613dfab613c, user_id=bc791ed3513e4bc39bfbe6711147ea59, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:11.126108 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c398f79-7fc8-46e1-b90d-2f5b3821b31a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:11.126297 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 797/1611] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:11.126297 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5c156-5b2f-4e1d-8ef2-570ffe519ac2 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:11.137386 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5c156-5b2f-4e1d-8ef2-570ffe519ac2 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:11.143234 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb19e5-31f7-4b04-af97-dffa2df86e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:11.143665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb19e5-31f7-4b04-af97-dffa2df86e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.143949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb19e5-31f7-4b04-af97-dffa2df86e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.144255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb19e5-31f7-4b04-af97-dffa2df86e6a admin admin] PATH_INFO: `/v3/projects/0075f351f48548d3825104e3bf1fe7af/users/6453d470db164809a3168d4d6632e5da/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.146596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 815/1612] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:11 2022] PUT /identity/v3/projects/8b8af4daf82a43db88622613dfab613c/users/bc791ed3513e4bc39bfbe6711147ea59/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:11.148149 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c398f79-7fc8-46e1-b90d-2f5b3821b31a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:11.163060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb19e5-31f7-4b04-af97-dffa2df86e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0075f351f48548d3825104e3bf1fe7af, user_id=6453d470db164809a3168d4d6632e5da, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:11.166408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb19e5-31f7-4b04-af97-dffa2df86e6a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:11.180611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 798/1613] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:11 2022] PUT /identity/v3/projects/0075f351f48548d3825104e3bf1fe7af/users/6453d470db164809a3168d4d6632e5da/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:11.181433 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb19e5-31f7-4b04-af97-dffa2df86e6a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:11.215856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c398f79-7fc8-46e1-b90d-2f5b3821b31a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:11.246099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb19e5-31f7-4b04-af97-dffa2df86e6a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:11.251120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8a508-ab5d-400b-836e-59a5564ac5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:11.252273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a508-ab5d-400b-836e-59a5564ac5bd service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.252273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a508-ab5d-400b-836e-59a5564ac5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.252556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8a508-ab5d-400b-836e-59a5564ac5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.276427 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea25cf1-86b0-46d6-93b0-867c299d1b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:11.277329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea25cf1-86b0-46d6-93b0-867c299d1b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.277590 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea25cf1-86b0-46d6-93b0-867c299d1b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.277868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea25cf1-86b0-46d6-93b0-867c299d1b98 admin admin] PATH_INFO: `/v3/projects/807e3c8517bb424488fe69433d86b305/users/375ae3f332944e2ab42545a39e324de8/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.292269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea25cf1-86b0-46d6-93b0-867c299d1b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807e3c8517bb424488fe69433d86b305, user_id=375ae3f332944e2ab42545a39e324de8, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:11.295204 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea25cf1-86b0-46d6-93b0-867c299d1b98 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:11.310481 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 816/1614] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:11 2022] PUT /identity/v3/projects/807e3c8517bb424488fe69433d86b305/users/375ae3f332944e2ab42545a39e324de8/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:11.314044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563fda6-6dd9-416c-82d4-49f2838e08df None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.314628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563fda6-6dd9-416c-82d4-49f2838e08df None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.314982 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563fda6-6dd9-416c-82d4-49f2838e08df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.317258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8a508-ab5d-400b-836e-59a5564ac5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:11.318789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8a508-ab5d-400b-836e-59a5564ac5bd service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:11.330643 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 799/1615] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:11.331311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8a508-ab5d-400b-836e-59a5564ac5bd service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:11.335230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2563fda6-6dd9-416c-82d4-49f2838e08df None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:11.336578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2563fda6-6dd9-416c-82d4-49f2838e08df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:11.341214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8a508-ab5d-400b-836e-59a5564ac5bd service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:11.410453 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950be468-1d42-40b2-975f-3e75c02573de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:11.412255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950be468-1d42-40b2-975f-3e75c02573de admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.413681 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950be468-1d42-40b2-975f-3e75c02573de admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.413990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950be468-1d42-40b2-975f-3e75c02573de admin admin] PATH_INFO: `/v3/projects/fd441a80d29f4b5db8245c523e2ee25a/users/2968933854654df18956bb48d4810159/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.439221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 817/1616] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:11.439221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563fda6-6dd9-416c-82d4-49f2838e08df None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:11.448578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950be468-1d42-40b2-975f-3e75c02573de admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd441a80d29f4b5db8245c523e2ee25a, user_id=2968933854654df18956bb48d4810159, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:11.452650 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950be468-1d42-40b2-975f-3e75c02573de admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:11.486863 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 800/1617] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:11 2022] PUT /identity/v3/projects/fd441a80d29f4b5db8245c523e2ee25a/users/2968933854654df18956bb48d4810159/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:11.497219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0048bf2-3b49-4cc2-895a-3af7f8d86f58 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.497486 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0048bf2-3b49-4cc2-895a-3af7f8d86f58 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.497771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0048bf2-3b49-4cc2-895a-3af7f8d86f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.544734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a0048bf2-3b49-4cc2-895a-3af7f8d86f58 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:11.548487 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a0048bf2-3b49-4cc2-895a-3af7f8d86f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:11.598497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563fda6-6dd9-416c-82d4-49f2838e08df None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:11.656163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 801/1618] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:11.660361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09dfa2-315f-4d29-a33b-baf11685740f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.661008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09dfa2-315f-4d29-a33b-baf11685740f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.661541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09dfa2-315f-4d29-a33b-baf11685740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.663209 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66274e-5ef2-4594-8551-c42a360e10b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:11.664060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66274e-5ef2-4594-8551-c42a360e10b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.664367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66274e-5ef2-4594-8551-c42a360e10b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.664707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66274e-5ef2-4594-8551-c42a360e10b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.704841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-5f09dfa2-315f-4d29-a33b-baf11685740f None None] MFA Rules not processed for user `6453d470db164809a3168d4d6632e5da`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:11.706049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-5f09dfa2-315f-4d29-a33b-baf11685740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:11.744370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66274e-5ef2-4594-8551-c42a360e10b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:11.746014 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66274e-5ef2-4594-8551-c42a360e10b2 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:11.756518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 818/1619] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:11.757687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb78abc-7982-4cef-a7d0-edbc39e31170 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.761324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb78abc-7982-4cef-a7d0-edbc39e31170 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.761324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb78abc-7982-4cef-a7d0-edbc39e31170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.799108 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9bb78abc-7982-4cef-a7d0-edbc39e31170 None None] MFA Rules not processed for user `375ae3f332944e2ab42545a39e324de8`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:11.801206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9bb78abc-7982-4cef-a7d0-edbc39e31170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:11.809570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 802/1620] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:11.809844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09dfa2-315f-4d29-a33b-baf11685740f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:11.897217 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09dfa2-315f-4d29-a33b-baf11685740f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:11.901875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf890b-f2a8-4a9e-a26d-43a4fcd4cd62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:11.902804 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf890b-f2a8-4a9e-a26d-43a4fcd4cd62 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.903399 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf890b-f2a8-4a9e-a26d-43a4fcd4cd62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.903935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf890b-f2a8-4a9e-a26d-43a4fcd4cd62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.919800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf890b-f2a8-4a9e-a26d-43a4fcd4cd62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:11.923655 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf890b-f2a8-4a9e-a26d-43a4fcd4cd62 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:11.927824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 819/1621] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:11.929985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676d629-a56a-42c9-afa0-565e161cbfa0 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.929985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676d629-a56a-42c9-afa0-565e161cbfa0 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.929985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676d629-a56a-42c9-afa0-565e161cbfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.937351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 803/1622] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:11.938818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf890b-f2a8-4a9e-a26d-43a4fcd4cd62 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:11.949997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf890b-f2a8-4a9e-a26d-43a4fcd4cd62 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:11.956214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e9447-e47b-4130-ae71-1258f69df88b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:11.956591 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e676d629-a56a-42c9-afa0-565e161cbfa0 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:11.957479 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e9447-e47b-4130-ae71-1258f69df88b service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.957975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e676d629-a56a-42c9-afa0-565e161cbfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:11.958249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e9447-e47b-4130-ae71-1258f69df88b service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.958852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e9447-e47b-4130-ae71-1258f69df88b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.968412 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 820/1623] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:11.969850 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676d629-a56a-42c9-afa0-565e161cbfa0 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:11.976175 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e9447-e47b-4130-ae71-1258f69df88b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:11.977732 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e9447-e47b-4130-ae71-1258f69df88b service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:11.987674 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676d629-a56a-42c9-afa0-565e161cbfa0 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:11.992086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 804/1624] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:11.992974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e9447-e47b-4130-ae71-1258f69df88b service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:11.993094 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f28b7-8567-434a-9882-2f173ac8c460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:11.993757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f28b7-8567-434a-9882-2f173ac8c460 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:11.994040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f28b7-8567-434a-9882-2f173ac8c460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:11.994445 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f28b7-8567-434a-9882-2f173ac8c460 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:11.995140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f28b7-8567-434a-9882-2f173ac8c460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:11.997711 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f28b7-8567-434a-9882-2f173ac8c460 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.005064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e9447-e47b-4130-ae71-1258f69df88b service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:12.012816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad71ff-4cda-4e2d-a10b-d92f38292e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:12.013597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad71ff-4cda-4e2d-a10b-d92f38292e84 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.014101 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad71ff-4cda-4e2d-a10b-d92f38292e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.014487 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad71ff-4cda-4e2d-a10b-d92f38292e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.016194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad71ff-4cda-4e2d-a10b-d92f38292e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:12.018820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad71ff-4cda-4e2d-a10b-d92f38292e84 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.036302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 821/1625] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:11 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:12.039898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f28b7-8567-434a-9882-2f173ac8c460 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:12.056997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 805/1626] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:11 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:12.056997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad71ff-4cda-4e2d-a10b-d92f38292e84 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:12.132102 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f28b7-8567-434a-9882-2f173ac8c460 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:12.145260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad71ff-4cda-4e2d-a10b-d92f38292e84 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:12.151115 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba652a9-9035-4ebb-963e-a123a44bdac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:12.152182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba652a9-9035-4ebb-963e-a123a44bdac1 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.154229 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba652a9-9035-4ebb-963e-a123a44bdac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.154229 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba652a9-9035-4ebb-963e-a123a44bdac1 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.154229 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba652a9-9035-4ebb-963e-a123a44bdac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:12.157287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba652a9-9035-4ebb-963e-a123a44bdac1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.183875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 806/1627] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:12 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:12.185172 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba652a9-9035-4ebb-963e-a123a44bdac1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:12.197407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fc4ca-4774-4c8c-ad79-97dcc63465c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:12.198076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fc4ca-4774-4c8c-ad79-97dcc63465c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.198355 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fc4ca-4774-4c8c-ad79-97dcc63465c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.198632 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fc4ca-4774-4c8c-ad79-97dcc63465c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.202377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba652a9-9035-4ebb-963e-a123a44bdac1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:12.209841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140896b1-855d-4148-bf95-6df7a1861ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:12.211363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140896b1-855d-4148-bf95-6df7a1861ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.211752 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fc4ca-4774-4c8c-ad79-97dcc63465c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:12.212187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140896b1-855d-4148-bf95-6df7a1861ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.212766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140896b1-855d-4148-bf95-6df7a1861ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.213791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fc4ca-4774-4c8c-ad79-97dcc63465c7 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.214391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140896b1-855d-4148-bf95-6df7a1861ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:12.220355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140896b1-855d-4148-bf95-6df7a1861ba6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.229764 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 822/1628] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:12.231011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fc4ca-4774-4c8c-ad79-97dcc63465c7 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:12.243025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fc4ca-4774-4c8c-ad79-97dcc63465c7 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:12.249835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c305b1-9e80-4bbd-814c-4a3f97b20177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:12.251232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c305b1-9e80-4bbd-814c-4a3f97b20177 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.251515 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c305b1-9e80-4bbd-814c-4a3f97b20177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.251791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c305b1-9e80-4bbd-814c-4a3f97b20177 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.252580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c305b1-9e80-4bbd-814c-4a3f97b20177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:12.253250 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 807/1629] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:12 2022] POST /identity/v3/users => generated 293 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:12.254406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140896b1-855d-4148-bf95-6df7a1861ba6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:12.254608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c305b1-9e80-4bbd-814c-4a3f97b20177 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.267983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140896b1-855d-4148-bf95-6df7a1861ba6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:12.271790 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 823/1630] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:12.273448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c305b1-9e80-4bbd-814c-4a3f97b20177 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:12.275811 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002e33b-30ce-4f09-a8c5-724dab0a08c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:12.275811 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002e33b-30ce-4f09-a8c5-724dab0a08c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.275811 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002e33b-30ce-4f09-a8c5-724dab0a08c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.275811 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002e33b-30ce-4f09-a8c5-724dab0a08c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.276416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002e33b-30ce-4f09-a8c5-724dab0a08c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:12.278273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002e33b-30ce-4f09-a8c5-724dab0a08c8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.288383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c305b1-9e80-4bbd-814c-4a3f97b20177 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:12.295562 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8f0db-1154-42da-8fb4-fced7ab33d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:12.295562 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8f0db-1154-42da-8fb4-fced7ab33d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.295562 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8f0db-1154-42da-8fb4-fced7ab33d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.296245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8f0db-1154-42da-8fb4-fced7ab33d6b admin admin] PATH_INFO: `/v3/projects/1b96a3bd13de41ba8600a58308e7193c/users/f1c844cd155a47689697f9b1e657f22f/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.297020 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 808/1631] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:12.298730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002e33b-30ce-4f09-a8c5-724dab0a08c8 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:12.309984 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002e33b-30ce-4f09-a8c5-724dab0a08c8 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:12.317087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8f0db-1154-42da-8fb4-fced7ab33d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b96a3bd13de41ba8600a58308e7193c, user_id=f1c844cd155a47689697f9b1e657f22f, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:12.317580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b686367-ca58-4eb2-ae16-1e196c3847dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:12.318931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b686367-ca58-4eb2-ae16-1e196c3847dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.319449 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b686367-ca58-4eb2-ae16-1e196c3847dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.319970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b686367-ca58-4eb2-ae16-1e196c3847dd admin admin] PATH_INFO: `/v3/projects/ea685923c2264fdeab1d3e8acdf564ec/users/277bd138ff3d420b90557569ef49b035/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.324494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8f0db-1154-42da-8fb4-fced7ab33d6b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.351703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 824/1632] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:12 2022] PUT /identity/v3/projects/1b96a3bd13de41ba8600a58308e7193c/users/f1c844cd155a47689697f9b1e657f22f/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:12.356399 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8f0db-1154-42da-8fb4-fced7ab33d6b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:12.360336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b686367-ca58-4eb2-ae16-1e196c3847dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea685923c2264fdeab1d3e8acdf564ec, user_id=277bd138ff3d420b90557569ef49b035, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:12.368701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b686367-ca58-4eb2-ae16-1e196c3847dd admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.409725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 809/1633] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:12 2022] PUT /identity/v3/projects/ea685923c2264fdeab1d3e8acdf564ec/users/277bd138ff3d420b90557569ef49b035/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:12.413844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b686367-ca58-4eb2-ae16-1e196c3847dd admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:12.480439 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8f0db-1154-42da-8fb4-fced7ab33d6b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:12.519652 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b686367-ca58-4eb2-ae16-1e196c3847dd admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:12.528095 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a85d66-d568-4628-81f6-ed3f84a5fa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:12.529191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a85d66-d568-4628-81f6-ed3f84a5fa9a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.529840 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a85d66-d568-4628-81f6-ed3f84a5fa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.530189 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a85d66-d568-4628-81f6-ed3f84a5fa9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.531239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a85d66-d568-4628-81f6-ed3f84a5fa9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:12.534675 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a85d66-d568-4628-81f6-ed3f84a5fa9a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.553176 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 810/1634] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:27:12.554907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a85d66-d568-4628-81f6-ed3f84a5fa9a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:12.571904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a85d66-d568-4628-81f6-ed3f84a5fa9a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:12.581200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490e654-ab59-452d-89e5-b8f10224d368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:12.581879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490e654-ab59-452d-89e5-b8f10224d368 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.582263 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490e654-ab59-452d-89e5-b8f10224d368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.582676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490e654-ab59-452d-89e5-b8f10224d368 admin admin] PATH_INFO: `/v3/projects/ea685923c2264fdeab1d3e8acdf564ec/users/277bd138ff3d420b90557569ef49b035/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.585277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490e654-ab59-452d-89e5-b8f10224d368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea685923c2264fdeab1d3e8acdf564ec, user_id=277bd138ff3d420b90557569ef49b035, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:12.588406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490e654-ab59-452d-89e5-b8f10224d368 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.612454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 811/1635] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:12 2022] PUT /identity/v3/projects/ea685923c2264fdeab1d3e8acdf564ec/users/277bd138ff3d420b90557569ef49b035/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:12.618405 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949f386-89d9-4d7d-b646-209fb64b7990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:12.619103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949f386-89d9-4d7d-b646-209fb64b7990 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.621144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949f386-89d9-4d7d-b646-209fb64b7990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.621870 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949f386-89d9-4d7d-b646-209fb64b7990 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.625451 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949f386-89d9-4d7d-b646-209fb64b7990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:12.627843 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a498a1a-0a64-4cf3-94ac-23023a7e50a5 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.628606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949f386-89d9-4d7d-b646-209fb64b7990 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.629331 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a498a1a-0a64-4cf3-94ac-23023a7e50a5 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.630788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a498a1a-0a64-4cf3-94ac-23023a7e50a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.655470 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 825/1636] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:27:12.656638 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949f386-89d9-4d7d-b646-209fb64b7990 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:12.680607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949f386-89d9-4d7d-b646-209fb64b7990 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:12.693701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-3a498a1a-0a64-4cf3-94ac-23023a7e50a5 None None] MFA Rules not processed for user `277bd138ff3d420b90557569ef49b035`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:12.695824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-3a498a1a-0a64-4cf3-94ac-23023a7e50a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:12.762702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdc968-366b-46cc-aa02-f02319ce8023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:12.763661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdc968-366b-46cc-aa02-f02319ce8023 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.763949 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdc968-366b-46cc-aa02-f02319ce8023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.764258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdc968-366b-46cc-aa02-f02319ce8023 admin admin] PATH_INFO: `/v3/projects/1b96a3bd13de41ba8600a58308e7193c/users/f1c844cd155a47689697f9b1e657f22f/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.766873 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdc968-366b-46cc-aa02-f02319ce8023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b96a3bd13de41ba8600a58308e7193c, user_id=f1c844cd155a47689697f9b1e657f22f, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:12.769812 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdc968-366b-46cc-aa02-f02319ce8023 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:12.785983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 826/1637] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:12 2022] PUT /identity/v3/projects/1b96a3bd13de41ba8600a58308e7193c/users/f1c844cd155a47689697f9b1e657f22f/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:12.797782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52f3e-9e24-49a5-9222-9a5ad6a0651e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:12.798379 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52f3e-9e24-49a5-9222-9a5ad6a0651e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:12.798697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f52f3e-9e24-49a5-9222-9a5ad6a0651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:12.843266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-48f52f3e-9e24-49a5-9222-9a5ad6a0651e None None] MFA Rules not processed for user `f1c844cd155a47689697f9b1e657f22f`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:12.846709 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-48f52f3e-9e24-49a5-9222-9a5ad6a0651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:12.882001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 812/1638] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:12.906479 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a498a1a-0a64-4cf3-94ac-23023a7e50a5 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:12.984050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 827/1639] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:13.021267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f52f3e-9e24-49a5-9222-9a5ad6a0651e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:13.035969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a498a1a-0a64-4cf3-94ac-23023a7e50a5 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:13.108890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9fa22-0eb0-404a-8a05-db80b7a53885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:13.111149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9fa22-0eb0-404a-8a05-db80b7a53885 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:13.111581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9fa22-0eb0-404a-8a05-db80b7a53885 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:13.111978 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9fa22-0eb0-404a-8a05-db80b7a53885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:13.150947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f52f3e-9e24-49a5-9222-9a5ad6a0651e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:13.161387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe084b7c-1ba3-4e93-afd6-55408266d33f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:13.162321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe084b7c-1ba3-4e93-afd6-55408266d33f service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:13.162616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe084b7c-1ba3-4e93-afd6-55408266d33f service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:13.171133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe084b7c-1ba3-4e93-afd6-55408266d33f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:13.199441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe084b7c-1ba3-4e93-afd6-55408266d33f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:13.201531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe084b7c-1ba3-4e93-afd6-55408266d33f service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:13.205898 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9fa22-0eb0-404a-8a05-db80b7a53885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:13.208402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9fa22-0eb0-404a-8a05-db80b7a53885 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:13.225963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 828/1640] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:27:13.235444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 813/1641] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:13.456762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe084b7c-1ba3-4e93-afd6-55408266d33f service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:13.472591 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe084b7c-1ba3-4e93-afd6-55408266d33f service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:13.477952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b50214-55f1-44bc-96b0-966b3dc8a19c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:13.479163 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b50214-55f1-44bc-96b0-966b3dc8a19c service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:13.479440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b50214-55f1-44bc-96b0-966b3dc8a19c service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:13.480184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b50214-55f1-44bc-96b0-966b3dc8a19c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:13.570024 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b50214-55f1-44bc-96b0-966b3dc8a19c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:13.572529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b50214-55f1-44bc-96b0-966b3dc8a19c service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:13.590346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 829/1642] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:14.002467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9fa22-0eb0-404a-8a05-db80b7a53885 service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:14.086057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9fa22-0eb0-404a-8a05-db80b7a53885 service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:14.105255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47780d-6ade-4050-8bb5-8a9f5cd380a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:14.106221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47780d-6ade-4050-8bb5-8a9f5cd380a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.106580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47780d-6ade-4050-8bb5-8a9f5cd380a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.106871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47780d-6ade-4050-8bb5-8a9f5cd380a4 admin admin] PATH_INFO: `/v3/users/375ae3f332944e2ab42545a39e324de8` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.109935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47780d-6ade-4050-8bb5-8a9f5cd380a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=375ae3f332944e2ab42545a39e324de8)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:14.116675 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47780d-6ade-4050-8bb5-8a9f5cd380a4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:14.134299 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5577bcc-4402-4ef4-9e34-f2a367897e48 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.134847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5577bcc-4402-4ef4-9e34-f2a367897e48 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.134847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5577bcc-4402-4ef4-9e34-f2a367897e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.199524 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a5577bcc-4402-4ef4-9e34-f2a367897e48 None None] MFA Rules not processed for user `bc791ed3513e4bc39bfbe6711147ea59`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:14.201126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a5577bcc-4402-4ef4-9e34-f2a367897e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:14.214000 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3b47780d-6ade-4050-8bb5-8a9f5cd380a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375ae3f332944e2ab42545a39e324de8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:14.240888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3b47780d-6ade-4050-8bb5-8a9f5cd380a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375ae3f332944e2ab42545a39e324de8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:14.260891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3b47780d-6ade-4050-8bb5-8a9f5cd380a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375ae3f332944e2ab42545a39e324de8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:14.272562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3b47780d-6ade-4050-8bb5-8a9f5cd380a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375ae3f332944e2ab42545a39e324de8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:14.274165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3b47780d-6ade-4050-8bb5-8a9f5cd380a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375ae3f332944e2ab42545a39e324de8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:14.287347 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 814/1643] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:14 2022] DELETE /identity/v3/users/375ae3f332944e2ab42545a39e324de8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:14.292432 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31638f-9fda-4ae5-a567-bf5c15764320 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.292938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31638f-9fda-4ae5-a567-bf5c15764320 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.293066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31638f-9fda-4ae5-a567-bf5c15764320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.337933 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-1b31638f-9fda-4ae5-a567-bf5c15764320 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:14.339427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1b31638f-9fda-4ae5-a567-bf5c15764320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:14.342292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 830/1644] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:14.349966 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36dd2b-eec2-4807-9858-66ef45ad7f39 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.350258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36dd2b-eec2-4807-9858-66ef45ad7f39 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.350592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36dd2b-eec2-4807-9858-66ef45ad7f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.398521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7a36dd2b-eec2-4807-9858-66ef45ad7f39 None None] MFA Rules not processed for user `bc791ed3513e4bc39bfbe6711147ea59`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:14.404985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7a36dd2b-eec2-4807-9858-66ef45ad7f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:14.438131 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 815/1645] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:14.440497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138e79d-d481-4505-94be-d51ba60c2f61 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.440879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138e79d-d481-4505-94be-d51ba60c2f61 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.441207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138e79d-d481-4505-94be-d51ba60c2f61 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.449290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 816/1646] 10.222.0.90 () {54 vars in 961 bytes} [Wed Feb 16 09:27:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:27:14.451230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4f1da-acad-4434-b64f-f08562c99474 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.451589 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4f1da-acad-4434-b64f-f08562c99474 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.452201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4f1da-acad-4434-b64f-f08562c99474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.488593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-83d4f1da-acad-4434-b64f-f08562c99474 None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:14.490637 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-83d4f1da-acad-4434-b64f-f08562c99474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:14.510432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 831/1647] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:14.512832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36dd2b-eec2-4807-9858-66ef45ad7f39 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:14.518569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7a36dd2b-eec2-4807-9858-66ef45ad7f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:14.607717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 817/1648] 10.222.0.90 () {58 vars in 1058 bytes} [Wed Feb 16 09:27:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:14.618687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea213bef-edff-4019-a971-3d59dd15e68d None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.618687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea213bef-edff-4019-a971-3d59dd15e68d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.618687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea213bef-edff-4019-a971-3d59dd15e68d None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.620293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 818/1649] 10.222.0.90 () {54 vars in 961 bytes} [Wed Feb 16 09:27:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:27:14.624004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4f462-47b4-4e0e-98d5-5f3bb7e6a953 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.625571 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4f462-47b4-4e0e-98d5-5f3bb7e6a953 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.626101 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4f462-47b4-4e0e-98d5-5f3bb7e6a953 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.633184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 819/1650] 10.222.0.90 () {54 vars in 912 bytes} [Wed Feb 16 09:27:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:27:14.641435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033089c-1e4b-4971-8c84-0d76b8141086 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.641780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033089c-1e4b-4971-8c84-0d76b8141086 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.642054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033089c-1e4b-4971-8c84-0d76b8141086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.661581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36dd2b-eec2-4807-9858-66ef45ad7f39 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:14.675995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359b0a7-24ab-4154-8b9d-1bcd18419013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:14.676686 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359b0a7-24ab-4154-8b9d-1bcd18419013 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.676963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359b0a7-24ab-4154-8b9d-1bcd18419013 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.677607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359b0a7-24ab-4154-8b9d-1bcd18419013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.679971 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-3033089c-1e4b-4971-8c84-0d76b8141086 None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:14.682109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-3033089c-1e4b-4971-8c84-0d76b8141086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:14.695239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359b0a7-24ab-4154-8b9d-1bcd18419013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:14.696761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359b0a7-24ab-4154-8b9d-1bcd18419013 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:14.701735 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 820/1651] 10.222.0.90 () {58 vars in 1058 bytes} [Wed Feb 16 09:27:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:14.704501 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f5005-ed7d-40e0-b055-f0801d1c6dba None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.705073 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f5005-ed7d-40e0-b055-f0801d1c6dba None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.705470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f5005-ed7d-40e0-b055-f0801d1c6dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.720392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 832/1652] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:14.721111 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359b0a7-24ab-4154-8b9d-1bcd18419013 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:14.736491 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-6b9f5005-ed7d-40e0-b055-f0801d1c6dba None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:14.738293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6b9f5005-ed7d-40e0-b055-f0801d1c6dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:14.747495 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359b0a7-24ab-4154-8b9d-1bcd18419013 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:14.749715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 821/1653] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:27:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:14.767789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f5005-ed7d-40e0-b055-f0801d1c6dba None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:14.769694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6b9f5005-ed7d-40e0-b055-f0801d1c6dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:14.770977 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b9acb-e2d8-4ed2-b111-c102e1149cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:14.771916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b9acb-e2d8-4ed2-b111-c102e1149cf4 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.772296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b9acb-e2d8-4ed2-b111-c102e1149cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.772664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b9acb-e2d8-4ed2-b111-c102e1149cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.782788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b9acb-e2d8-4ed2-b111-c102e1149cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:14.784827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b9acb-e2d8-4ed2-b111-c102e1149cf4 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:14.798850 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 833/1654] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:14.844813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f5005-ed7d-40e0-b055-f0801d1c6dba None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:14.849390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca06f97-8ae3-4d4d-88d0-274c3586cf71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:14.850258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca06f97-8ae3-4d4d-88d0-274c3586cf71 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:14.850753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca06f97-8ae3-4d4d-88d0-274c3586cf71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:14.851182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca06f97-8ae3-4d4d-88d0-274c3586cf71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:14.867049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca06f97-8ae3-4d4d-88d0-274c3586cf71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:14.869182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca06f97-8ae3-4d4d-88d0-274c3586cf71 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:14.883502 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 822/1655] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:27:15.217503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8da03-ad1b-4c5e-a604-9c5bbc991026 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:15.218965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8da03-ad1b-4c5e-a604-9c5bbc991026 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:15.219444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8da03-ad1b-4c5e-a604-9c5bbc991026 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:15.222406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 834/1656] 10.222.0.90 () {54 vars in 912 bytes} [Wed Feb 16 09:27:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:27:15.228275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9cc8-947b-48a9-abb0-4ddb2aaff32b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:15.228835 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9cc8-947b-48a9-abb0-4ddb2aaff32b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:15.228835 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c9cc8-947b-48a9-abb0-4ddb2aaff32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:15.260710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-8f3c9cc8-947b-48a9-abb0-4ddb2aaff32b None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:15.261944 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8f3c9cc8-947b-48a9-abb0-4ddb2aaff32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:15.293652 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 823/1657] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:27:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:15.309501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8da03-ad1b-4c5e-a604-9c5bbc991026 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:15.309501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bbb8da03-ad1b-4c5e-a604-9c5bbc991026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:15.449540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8da03-ad1b-4c5e-a604-9c5bbc991026 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:15.461731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae37dd-9916-4b0d-a6be-9dba1147a712 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5074090dca0b4a49b54dc252a5dd9420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:15.462407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae37dd-9916-4b0d-a6be-9dba1147a712 service glance] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:15.462693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae37dd-9916-4b0d-a6be-9dba1147a712 service glance] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:15.462968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae37dd-9916-4b0d-a6be-9dba1147a712 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:15.499187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae37dd-9916-4b0d-a6be-9dba1147a712 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:15.499790 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae37dd-9916-4b0d-a6be-9dba1147a712 service glance] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:15.525290 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 835/1658] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:16.365685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f508f-a201-43e4-95d9-dc53da0aeca0 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:16.366239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f508f-a201-43e4-95d9-dc53da0aeca0 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:16.366461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f508f-a201-43e4-95d9-dc53da0aeca0 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:16.368819 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 824/1659] 10.222.0.90 () {54 vars in 912 bytes} [Wed Feb 16 09:27:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:27:16.380238 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043f5e8-4659-406c-a449-11168dca506e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:16.380835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043f5e8-4659-406c-a449-11168dca506e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:16.380835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043f5e8-4659-406c-a449-11168dca506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:16.403936 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4043f5e8-4659-406c-a449-11168dca506e None None] MFA Rules not processed for user `39d5d18c09054343b4e000950ba875fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:16.407709 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4043f5e8-4659-406c-a449-11168dca506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:16.430701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 836/1660] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:27:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:16.666869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f508f-a201-43e4-95d9-dc53da0aeca0 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:16.669195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-bf8f508f-a201-43e4-95d9-dc53da0aeca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:16.699771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f508f-a201-43e4-95d9-dc53da0aeca0 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:16.709395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396b592-da4a-4763-b032-466ddfcce1f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:16.711553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396b592-da4a-4763-b032-466ddfcce1f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:16.711901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396b592-da4a-4763-b032-466ddfcce1f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:16.712276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396b592-da4a-4763-b032-466ddfcce1f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:16.720474 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1396b592-da4a-4763-b032-466ddfcce1f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:16.841706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043f5e8-4659-406c-a449-11168dca506e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:16.844402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4043f5e8-4659-406c-a449-11168dca506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:16.886525 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043f5e8-4659-406c-a449-11168dca506e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:16.901321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9489e-ee32-4fda-bf56-1615c6d1654b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:16.902640 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9489e-ee32-4fda-bf56-1615c6d1654b service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:16.902925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9489e-ee32-4fda-bf56-1615c6d1654b service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:16.903221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9489e-ee32-4fda-bf56-1615c6d1654b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:16.909108 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396b592-da4a-4763-b032-466ddfcce1f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:16.910695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396b592-da4a-4763-b032-466ddfcce1f0 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:16.924322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9489e-ee32-4fda-bf56-1615c6d1654b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:16.927567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9489e-ee32-4fda-bf56-1615c6d1654b service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:16.954693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 825/1661] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:16.955351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396b592-da4a-4763-b032-466ddfcce1f0 service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:16.978526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1396b592-da4a-4763-b032-466ddfcce1f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:16.989602 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 837/1662] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:17.007492 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396b592-da4a-4763-b032-466ddfcce1f0 service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:17.022873 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:17.022873 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:17.022873 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:17.024068 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] PATH_INFO: `/v3/projects/807e3c8517bb424488fe69433d86b305` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:17.026389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=807e3c8517bb424488fe69433d86b305)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:17.027648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: WARNING py.warnings [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:27:17.027648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: warnings.warn(msg) Feb 16 09:27:17.027648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: Feb 16 09:27:17.029014 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:17.139552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807e3c8517bb424488fe69433d86b305', 'request_id': 'req-0c04c752-2aec-4e6b-902d-0030ddbb06b5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:17.153938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807e3c8517bb424488fe69433d86b305', 'request_id': 'req-0c04c752-2aec-4e6b-902d-0030ddbb06b5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:17.196679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807e3c8517bb424488fe69433d86b305', 'request_id': 'req-0c04c752-2aec-4e6b-902d-0030ddbb06b5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:17.227506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] The token cache is being invalidate because project 807e3c8517bb424488fe69433d86b305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:17.227883 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:17.228802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c04c752-2aec-4e6b-902d-0030ddbb06b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:17.232253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 826/1663] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:16 2022] DELETE /identity/v3/projects/807e3c8517bb424488fe69433d86b305 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:17.237391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9489e-ee32-4fda-bf56-1615c6d1654b service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:17.267667 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9489e-ee32-4fda-bf56-1615c6d1654b service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:17.477594 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78df87e-0f4e-4c36-a5e5-11e4f862c55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:17.478480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78df87e-0f4e-4c36-a5e5-11e4f862c55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:17.478757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78df87e-0f4e-4c36-a5e5-11e4f862c55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:17.479153 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78df87e-0f4e-4c36-a5e5-11e4f862c55a admin admin] PATH_INFO: `/v3/users/277bd138ff3d420b90557569ef49b035` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:17.480637 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78df87e-0f4e-4c36-a5e5-11e4f862c55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=277bd138ff3d420b90557569ef49b035)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:17.481661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: WARNING py.warnings [None req-d78df87e-0f4e-4c36-a5e5-11e4f862c55a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 09:27:17.481661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: warnings.warn(msg) Feb 16 09:27:17.481661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: Feb 16 09:27:17.482853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78df87e-0f4e-4c36-a5e5-11e4f862c55a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:17.669959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d78df87e-0f4e-4c36-a5e5-11e4f862c55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277bd138ff3d420b90557569ef49b035'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:17.722099 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d78df87e-0f4e-4c36-a5e5-11e4f862c55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277bd138ff3d420b90557569ef49b035'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:17.726086 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d78df87e-0f4e-4c36-a5e5-11e4f862c55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277bd138ff3d420b90557569ef49b035'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:17.753233 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d78df87e-0f4e-4c36-a5e5-11e4f862c55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277bd138ff3d420b90557569ef49b035'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:17.784564 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d78df87e-0f4e-4c36-a5e5-11e4f862c55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277bd138ff3d420b90557569ef49b035'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:17.802342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 838/1664] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:17 2022] DELETE /identity/v3/users/277bd138ff3d420b90557569ef49b035 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:18.758242 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e84a0-9769-49f9-86d4-16833984518f None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:18.761075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e84a0-9769-49f9-86d4-16833984518f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:18.766235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e84a0-9769-49f9-86d4-16833984518f None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:18.769761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 827/1665] 10.222.0.90 () {54 vars in 960 bytes} [Wed Feb 16 09:27:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:27:18.775237 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147423-7240-4870-9e75-dcf6bfecd4b2 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:18.776247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147423-7240-4870-9e75-dcf6bfecd4b2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:18.776718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147423-7240-4870-9e75-dcf6bfecd4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:18.816395 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b6147423-7240-4870-9e75-dcf6bfecd4b2 None None] MFA Rules not processed for user `7d870fbd90cb4fde9ceafd2b737795eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:18.818261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b6147423-7240-4870-9e75-dcf6bfecd4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:18.943889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 839/1666] 10.222.0.90 () {58 vars in 1057 bytes} [Wed Feb 16 09:27:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:18.954937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e84a0-9769-49f9-86d4-16833984518f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:18.982086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e84a0-9769-49f9-86d4-16833984518f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:18.990497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f54b5d-ae63-42e3-8827-00977a3d9c56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d870fbd90cb4fde9ceafd2b737795eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:18.991698 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f54b5d-ae63-42e3-8827-00977a3d9c56 service placement] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:18.992340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f54b5d-ae63-42e3-8827-00977a3d9c56 service placement] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:18.993539 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f54b5d-ae63-42e3-8827-00977a3d9c56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:18.996932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c2f54b5d-ae63-42e3-8827-00977a3d9c56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:19.013195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f54b5d-ae63-42e3-8827-00977a3d9c56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:19.017532 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f54b5d-ae63-42e3-8827-00977a3d9c56 service placement] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:19.049052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 828/1667] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:19.586210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6147423-7240-4870-9e75-dcf6bfecd4b2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:19.588435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b6147423-7240-4870-9e75-dcf6bfecd4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:19.719545 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6147423-7240-4870-9e75-dcf6bfecd4b2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:19.729441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a9315-e17f-41fb-8498-e5a773337db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:19.730337 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a9315-e17f-41fb-8498-e5a773337db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:19.730621 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a9315-e17f-41fb-8498-e5a773337db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:19.730900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a9315-e17f-41fb-8498-e5a773337db1 admin admin] PATH_INFO: `/v3/projects/ea685923c2264fdeab1d3e8acdf564ec` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:19.733464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a9315-e17f-41fb-8498-e5a773337db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea685923c2264fdeab1d3e8acdf564ec)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:19.737769 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a9315-e17f-41fb-8498-e5a773337db1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:19.863111 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-119a9315-e17f-41fb-8498-e5a773337db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea685923c2264fdeab1d3e8acdf564ec', 'request_id': 'req-119a9315-e17f-41fb-8498-e5a773337db1'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:19.872045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-119a9315-e17f-41fb-8498-e5a773337db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea685923c2264fdeab1d3e8acdf564ec', 'request_id': 'req-119a9315-e17f-41fb-8498-e5a773337db1'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:19.882082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-119a9315-e17f-41fb-8498-e5a773337db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea685923c2264fdeab1d3e8acdf564ec', 'request_id': 'req-119a9315-e17f-41fb-8498-e5a773337db1'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:19.910285 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-119a9315-e17f-41fb-8498-e5a773337db1 admin admin] The token cache is being invalidate because project ea685923c2264fdeab1d3e8acdf564ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:19.910762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-119a9315-e17f-41fb-8498-e5a773337db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:19.914757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-119a9315-e17f-41fb-8498-e5a773337db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:19.920837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 840/1668] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:19 2022] DELETE /identity/v3/projects/ea685923c2264fdeab1d3e8acdf564ec => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:19.927647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0bbab-d52b-4af6-8280-709186b2e2cb None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:19.928269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0bbab-d52b-4af6-8280-709186b2e2cb None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:19.928720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0bbab-d52b-4af6-8280-709186b2e2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:19.970750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-8ef0bbab-d52b-4af6-8280-709186b2e2cb None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:19.973741 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8ef0bbab-d52b-4af6-8280-709186b2e2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:20.192643 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 829/1669] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:20.203550 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfab03c-38c8-4df2-b4ee-07c4ccbc0be3 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:20.204486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfab03c-38c8-4df2-b4ee-07c4ccbc0be3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:20.205449 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfab03c-38c8-4df2-b4ee-07c4ccbc0be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:20.246919 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0dfab03c-38c8-4df2-b4ee-07c4ccbc0be3 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:20.249595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0dfab03c-38c8-4df2-b4ee-07c4ccbc0be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:20.266817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 841/1670] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:20.275394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0bbab-d52b-4af6-8280-709186b2e2cb None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:20.309520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0bbab-d52b-4af6-8280-709186b2e2cb None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:20.322530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad611e-8dcd-46e6-9fb7-6a4ce6a0ca57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:20.323635 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad611e-8dcd-46e6-9fb7-6a4ce6a0ca57 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:20.324198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad611e-8dcd-46e6-9fb7-6a4ce6a0ca57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:20.325330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad611e-8dcd-46e6-9fb7-6a4ce6a0ca57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:20.326492 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad611e-8dcd-46e6-9fb7-6a4ce6a0ca57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:20.327001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad611e-8dcd-46e6-9fb7-6a4ce6a0ca57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:20.331298 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad611e-8dcd-46e6-9fb7-6a4ce6a0ca57 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:20.381279 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 830/1671] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:20.385990 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfab03c-38c8-4df2-b4ee-07c4ccbc0be3 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:20.402798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfab03c-38c8-4df2-b4ee-07c4ccbc0be3 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:20.417475 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c4473-2b96-4b7e-a9f5-65c1d5cb8b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:20.418864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c4473-2b96-4b7e-a9f5-65c1d5cb8b9f admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:20.422837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c4473-2b96-4b7e-a9f5-65c1d5cb8b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:20.423339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c4473-2b96-4b7e-a9f5-65c1d5cb8b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:20.424331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c4473-2b96-4b7e-a9f5-65c1d5cb8b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:20.429163 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c4473-2b96-4b7e-a9f5-65c1d5cb8b9f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:20.524325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad611e-8dcd-46e6-9fb7-6a4ce6a0ca57 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:20.525074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 842/1672] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:20 2022] POST /identity/v3/projects => generated 357 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:20.544747 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad611e-8dcd-46e6-9fb7-6a4ce6a0ca57 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:20.647443 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c2bdd-035e-442c-bafb-f3fd891d5a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:20.649023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c2bdd-035e-442c-bafb-f3fd891d5a39 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:20.649467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c2bdd-035e-442c-bafb-f3fd891d5a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:20.650194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c2bdd-035e-442c-bafb-f3fd891d5a39 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:20.651136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c2bdd-035e-442c-bafb-f3fd891d5a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:20.653554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c2bdd-035e-442c-bafb-f3fd891d5a39 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:20.699916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c4473-2b96-4b7e-a9f5-65c1d5cb8b9f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:20.712957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 831/1673] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:20 2022] POST /identity/v3/users => generated 279 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:27:20.717437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c4473-2b96-4b7e-a9f5-65c1d5cb8b9f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:20.725411 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6ba79-a075-49c3-9084-010cce0bca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:20.726647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6ba79-a075-49c3-9084-010cce0bca8b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:20.727090 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6ba79-a075-49c3-9084-010cce0bca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:20.727559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6ba79-a075-49c3-9084-010cce0bca8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:20.728991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6ba79-a075-49c3-9084-010cce0bca8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:20.733081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6ba79-a075-49c3-9084-010cce0bca8b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:20.756116 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c2bdd-035e-442c-bafb-f3fd891d5a39 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:20.768685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 843/1674] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:20.771538 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c2bdd-035e-442c-bafb-f3fd891d5a39 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:20.777792 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6113d8f4-639a-4117-a338-774fb65918c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:20.778774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113d8f4-639a-4117-a338-774fb65918c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:20.778914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113d8f4-639a-4117-a338-774fb65918c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:20.779245 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6113d8f4-639a-4117-a338-774fb65918c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:20.780254 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113d8f4-639a-4117-a338-774fb65918c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:20.783663 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6113d8f4-639a-4117-a338-774fb65918c7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:20.802188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6ba79-a075-49c3-9084-010cce0bca8b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:20.811940 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 832/1675] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:20.814513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6ba79-a075-49c3-9084-010cce0bca8b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:20.822348 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a36e0-ab96-46dd-8f47-72fbe5220ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:20.823273 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a36e0-ab96-46dd-8f47-72fbe5220ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:20.823556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a36e0-ab96-46dd-8f47-72fbe5220ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:20.823834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a36e0-ab96-46dd-8f47-72fbe5220ad8 admin admin] PATH_INFO: `/v3/projects/606fd327fac94eae912ed8be0bc0611d/users/91216177e0f4401d9d632f8da0af4d2d/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:20.857878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a36e0-ab96-46dd-8f47-72fbe5220ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=606fd327fac94eae912ed8be0bc0611d, user_id=91216177e0f4401d9d632f8da0af4d2d, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:20.894829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a36e0-ab96-46dd-8f47-72fbe5220ad8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:20.915560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 844/1676] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:20 2022] PUT /identity/v3/projects/606fd327fac94eae912ed8be0bc0611d/users/91216177e0f4401d9d632f8da0af4d2d/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:20.920725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9e618-ff2d-4f4e-90ec-b2087cc5dbb5 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:20.922221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9e618-ff2d-4f4e-90ec-b2087cc5dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:20.922676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9e618-ff2d-4f4e-90ec-b2087cc5dbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:20.965726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-05e9e618-ff2d-4f4e-90ec-b2087cc5dbb5 None None] MFA Rules not processed for user `91216177e0f4401d9d632f8da0af4d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:20.967134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-05e9e618-ff2d-4f4e-90ec-b2087cc5dbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:21.133276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 833/1677] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:20 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:21.138943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a36e0-ab96-46dd-8f47-72fbe5220ad8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:21.272298 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a36e0-ab96-46dd-8f47-72fbe5220ad8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:21.290224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8024b-bbd9-4ee8-9622-f4f74627eb9f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:21.290712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8024b-bbd9-4ee8-9622-f4f74627eb9f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:21.294995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab9b1a-49f9-4307-bc94-a7041aab9a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:21.295856 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8024b-bbd9-4ee8-9622-f4f74627eb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:21.296263 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab9b1a-49f9-4307-bc94-a7041aab9a64 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:21.296782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab9b1a-49f9-4307-bc94-a7041aab9a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:21.297310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab9b1a-49f9-4307-bc94-a7041aab9a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:21.298510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab9b1a-49f9-4307-bc94-a7041aab9a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:21.301398 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab9b1a-49f9-4307-bc94-a7041aab9a64 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:21.364269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 845/1678] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:21 2022] POST /identity/v3/projects => generated 357 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:21.366377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-eaf8024b-bbd9-4ee8-9622-f4f74627eb9f None None] MFA Rules not processed for user `2968933854654df18956bb48d4810159`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:21.367390 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab9b1a-49f9-4307-bc94-a7041aab9a64 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:21.368099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-eaf8024b-bbd9-4ee8-9622-f4f74627eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:21.518109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab9b1a-49f9-4307-bc94-a7041aab9a64 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:21.536625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af75fd-3f50-49db-a54b-aca87d6b7444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:21.537326 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af75fd-3f50-49db-a54b-aca87d6b7444 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:21.537607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af75fd-3f50-49db-a54b-aca87d6b7444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:21.538024 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af75fd-3f50-49db-a54b-aca87d6b7444 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:21.538725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af75fd-3f50-49db-a54b-aca87d6b7444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:21.541305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af75fd-3f50-49db-a54b-aca87d6b7444 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:21.554417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 834/1679] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:21.566953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8024b-bbd9-4ee8-9622-f4f74627eb9f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:21.570063 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-eaf8024b-bbd9-4ee8-9622-f4f74627eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:21.586881 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 846/1680] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:21 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:21.588741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af75fd-3f50-49db-a54b-aca87d6b7444 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:21.607806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af75fd-3f50-49db-a54b-aca87d6b7444 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:21.620192 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5072c0-6b20-45d3-9d54-23c81bc6fb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:21.620852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5072c0-6b20-45d3-9d54-23c81bc6fb22 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:21.621135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5072c0-6b20-45d3-9d54-23c81bc6fb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:21.621410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5072c0-6b20-45d3-9d54-23c81bc6fb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:21.624970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5072c0-6b20-45d3-9d54-23c81bc6fb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:21.629043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5072c0-6b20-45d3-9d54-23c81bc6fb22 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:21.666176 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 847/1681] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:27:21.667545 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5072c0-6b20-45d3-9d54-23c81bc6fb22 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:21.691634 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5072c0-6b20-45d3-9d54-23c81bc6fb22 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:21.699921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda76f77-aba8-40c9-9d63-e1513d1513fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:21.700989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda76f77-aba8-40c9-9d63-e1513d1513fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:21.701284 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda76f77-aba8-40c9-9d63-e1513d1513fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:21.702064 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda76f77-aba8-40c9-9d63-e1513d1513fe admin admin] PATH_INFO: `/v3/projects/46afae0d87304c37bf7ac42de4a68e0c/users/dbf3aad171104246963c853ba43deb7d/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:21.754741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda76f77-aba8-40c9-9d63-e1513d1513fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=46afae0d87304c37bf7ac42de4a68e0c, user_id=dbf3aad171104246963c853ba43deb7d, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:21.756239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8024b-bbd9-4ee8-9622-f4f74627eb9f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:21.757435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda76f77-aba8-40c9-9d63-e1513d1513fe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:21.764360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f02715-dd85-405e-bf7f-b08bd7fc2c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:21.766773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f02715-dd85-405e-bf7f-b08bd7fc2c28 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:21.766773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f02715-dd85-405e-bf7f-b08bd7fc2c28 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:21.767849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f02715-dd85-405e-bf7f-b08bd7fc2c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:21.782308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 848/1682] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:21 2022] PUT /identity/v3/projects/46afae0d87304c37bf7ac42de4a68e0c/users/dbf3aad171104246963c853ba43deb7d/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:27:21.786097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda76f77-aba8-40c9-9d63-e1513d1513fe admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:21.790505 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f02715-dd85-405e-bf7f-b08bd7fc2c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:21.796513 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f02715-dd85-405e-bf7f-b08bd7fc2c28 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:21.832531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 835/1683] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:21.897862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda76f77-aba8-40c9-9d63-e1513d1513fe admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:21.915209 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6cc26-8d89-4b6c-a9f5-d498b382ac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:21.916839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6cc26-8d89-4b6c-a9f5-d498b382ac92 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:21.917665 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6cc26-8d89-4b6c-a9f5-d498b382ac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:21.919098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6cc26-8d89-4b6c-a9f5-d498b382ac92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:21.920354 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6cc26-8d89-4b6c-a9f5-d498b382ac92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:21.923255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6cc26-8d89-4b6c-a9f5-d498b382ac92 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:21.954687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 849/1684] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:21.959067 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f02715-dd85-405e-bf7f-b08bd7fc2c28 service nova] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:21.979785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f02715-dd85-405e-bf7f-b08bd7fc2c28 service nova] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:21.988865 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df2e9d-1d3e-46d1-b2de-ab8db23318a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:21.990786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df2e9d-1d3e-46d1-b2de-ab8db23318a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:21.991307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df2e9d-1d3e-46d1-b2de-ab8db23318a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:21.991798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df2e9d-1d3e-46d1-b2de-ab8db23318a0 admin admin] PATH_INFO: `/v3/projects/46afae0d87304c37bf7ac42de4a68e0c/users/dbf3aad171104246963c853ba43deb7d/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:21.996519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df2e9d-1d3e-46d1-b2de-ab8db23318a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46afae0d87304c37bf7ac42de4a68e0c, user_id=dbf3aad171104246963c853ba43deb7d, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:22.004709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9df2e9d-1d3e-46d1-b2de-ab8db23318a0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:22.042610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 836/1685] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:21 2022] PUT /identity/v3/projects/46afae0d87304c37bf7ac42de4a68e0c/users/dbf3aad171104246963c853ba43deb7d/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:22.053334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181c432-4379-4c35-9259-9161ebfa1d2f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:22.053625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181c432-4379-4c35-9259-9161ebfa1d2f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:22.053901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181c432-4379-4c35-9259-9161ebfa1d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:22.107416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1181c432-4379-4c35-9259-9161ebfa1d2f None None] MFA Rules not processed for user `dbf3aad171104246963c853ba43deb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:22.108920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1181c432-4379-4c35-9259-9161ebfa1d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:22.314296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 850/1686] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:22 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:22.327531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df2e9d-1d3e-46d1-b2de-ab8db23318a0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:22.330093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-b9df2e9d-1d3e-46d1-b2de-ab8db23318a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:22.502961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9df2e9d-1d3e-46d1-b2de-ab8db23318a0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:22.516439 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b61c0b-640c-4dde-81b1-6ad381c1fc6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:22.517252 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61c0b-640c-4dde-81b1-6ad381c1fc6f service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:22.517684 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61c0b-640c-4dde-81b1-6ad381c1fc6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:22.518107 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b61c0b-640c-4dde-81b1-6ad381c1fc6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:22.544644 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b61c0b-640c-4dde-81b1-6ad381c1fc6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:22.547281 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b61c0b-640c-4dde-81b1-6ad381c1fc6f service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:22.576267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 837/1687] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:22 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:22.795460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181c432-4379-4c35-9259-9161ebfa1d2f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:22.813554 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181c432-4379-4c35-9259-9161ebfa1d2f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:22.822452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364f90f-41f8-4056-b8be-69c028f7a207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:22.823270 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364f90f-41f8-4056-b8be-69c028f7a207 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:22.823755 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364f90f-41f8-4056-b8be-69c028f7a207 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:22.824058 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364f90f-41f8-4056-b8be-69c028f7a207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:23.040107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364f90f-41f8-4056-b8be-69c028f7a207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:23.041750 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364f90f-41f8-4056-b8be-69c028f7a207 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:23.067026 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 851/1688] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:22 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:24.679331 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614494b5-82ea-4ae2-96f1-fed7aabe8ca2 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:24.680252 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614494b5-82ea-4ae2-96f1-fed7aabe8ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:24.682361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614494b5-82ea-4ae2-96f1-fed7aabe8ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:24.747927 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-614494b5-82ea-4ae2-96f1-fed7aabe8ca2 None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:24.751907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-614494b5-82ea-4ae2-96f1-fed7aabe8ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:24.913988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 838/1689] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:27:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:25.223876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364f90f-41f8-4056-b8be-69c028f7a207 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:25.225955 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7364f90f-41f8-4056-b8be-69c028f7a207 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:25.481784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364f90f-41f8-4056-b8be-69c028f7a207 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:25.517756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0a46a-1ef5-4454-b240-7e3b5ff1e73e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:25.518424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0a46a-1ef5-4454-b240-7e3b5ff1e73e service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:25.518706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0a46a-1ef5-4454-b240-7e3b5ff1e73e service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:25.518977 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0a46a-1ef5-4454-b240-7e3b5ff1e73e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:25.552792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0a46a-1ef5-4454-b240-7e3b5ff1e73e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:25.554516 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0a46a-1ef5-4454-b240-7e3b5ff1e73e service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:25.611692 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 852/1690] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:27:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:27:25.828159 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b942e-5651-45d0-a127-4a4fbf023422 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:25.828686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b942e-5651-45d0-a127-4a4fbf023422 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:25.828845 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b942e-5651-45d0-a127-4a4fbf023422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:25.894636 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-e67b942e-5651-45d0-a127-4a4fbf023422 None None] MFA Rules not processed for user `2968933854654df18956bb48d4810159`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:25.896857 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e67b942e-5651-45d0-a127-4a4fbf023422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:26.107100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 839/1691] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:27.656582 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dcac0-c0f7-41fa-afbe-31bbfa99562a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:27.658221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dcac0-c0f7-41fa-afbe-31bbfa99562a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:27.660340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dcac0-c0f7-41fa-afbe-31bbfa99562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:27.700779 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9a2dcac0-c0f7-41fa-afbe-31bbfa99562a None None] MFA Rules not processed for user `53dc4402074b44deb42d688bc302a58c`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:27.702404 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9a2dcac0-c0f7-41fa-afbe-31bbfa99562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:27.876288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 853/1692] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:27.887353 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f513e-63fc-4154-b780-2d46272d04f3 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:27.890559 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f513e-63fc-4154-b780-2d46272d04f3 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:27.891026 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f513e-63fc-4154-b780-2d46272d04f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:27.946062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dcac0-c0f7-41fa-afbe-31bbfa99562a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:28.020049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-3d4f513e-63fc-4154-b780-2d46272d04f3 None None] MFA Rules not processed for user `ff9ca3b6201b4f5780ccb309dc0440c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:28.024287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-3d4f513e-63fc-4154-b780-2d46272d04f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:28.240756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dcac0-c0f7-41fa-afbe-31bbfa99562a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:28.261014 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fad68-a1f9-4573-a269-f7d7baa986c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:28.261700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fad68-a1f9-4573-a269-f7d7baa986c8 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:28.262002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fad68-a1f9-4573-a269-f7d7baa986c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:28.262265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fad68-a1f9-4573-a269-f7d7baa986c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:28.286726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 840/1693] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:28.290840 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f467-6c80-47e8-8174-4495664e08f5 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:28.299976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fad68-a1f9-4573-a269-f7d7baa986c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:28.302663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fad68-a1f9-4573-a269-f7d7baa986c8 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:28.306454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f467-6c80-47e8-8174-4495664e08f5 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:28.307344 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9f467-6c80-47e8-8174-4495664e08f5 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:28.312064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 841/1694] 10.222.0.90 () {54 vars in 912 bytes} [Wed Feb 16 09:27:28 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:27:28.317282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba4f66-cf19-4c12-ba00-5f79c7e3ec5c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:28.319272 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba4f66-cf19-4c12-ba00-5f79c7e3ec5c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:28.323055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba4f66-cf19-4c12-ba00-5f79c7e3ec5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:28.340507 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 854/1695] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:27:28.342854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db524-f055-4c83-9d40-4be15f043b05 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:28.343262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db524-f055-4c83-9d40-4be15f043b05 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:28.343801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db524-f055-4c83-9d40-4be15f043b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:28.394173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-4eba4f66-cf19-4c12-ba00-5f79c7e3ec5c None None] MFA Rules not processed for user `ff9ca3b6201b4f5780ccb309dc0440c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:28.401733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4eba4f66-cf19-4c12-ba00-5f79c7e3ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:28.411580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6a7db524-f055-4c83-9d40-4be15f043b05 None None] MFA Rules not processed for user `39d5d18c09054343b4e000950ba875fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:28.420212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6a7db524-f055-4c83-9d40-4be15f043b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:28.434718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 842/1696] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:28.606366 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 855/1697] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:27:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:28.622317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba4f66-cf19-4c12-ba00-5f79c7e3ec5c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:28.624189 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4eba4f66-cf19-4c12-ba00-5f79c7e3ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:28.648981 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba4f66-cf19-4c12-ba00-5f79c7e3ec5c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:28.656685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73f70-bd73-41d0-8324-f61612573270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:28.658189 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73f70-bd73-41d0-8324-f61612573270 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:28.658473 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73f70-bd73-41d0-8324-f61612573270 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:28.658745 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73f70-bd73-41d0-8324-f61612573270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:28.668808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce73f70-bd73-41d0-8324-f61612573270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:28.670785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce73f70-bd73-41d0-8324-f61612573270 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:28.686291 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 843/1698] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:29.714367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7db524-f055-4c83-9d40-4be15f043b05 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:29.717085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6a7db524-f055-4c83-9d40-4be15f043b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:29.756435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7db524-f055-4c83-9d40-4be15f043b05 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:29.772760 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094251ad-dfd8-49b4-be8d-4783b035de7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:29.773538 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094251ad-dfd8-49b4-be8d-4783b035de7c service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:29.774250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094251ad-dfd8-49b4-be8d-4783b035de7c service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:29.774346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094251ad-dfd8-49b4-be8d-4783b035de7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:29.804754 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094251ad-dfd8-49b4-be8d-4783b035de7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:29.809433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094251ad-dfd8-49b4-be8d-4783b035de7c service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:29.842731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 856/1699] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:27:31.376162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77479e0-5197-4909-ad08-ec07a4047dc2 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:31.376761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77479e0-5197-4909-ad08-ec07a4047dc2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:31.376941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77479e0-5197-4909-ad08-ec07a4047dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:31.436065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-c77479e0-5197-4909-ad08-ec07a4047dc2 None None] MFA Rules not processed for user `39d5d18c09054343b4e000950ba875fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:31.446720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c77479e0-5197-4909-ad08-ec07a4047dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:31.482372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 844/1700] 10.222.0.24 () {58 vars in 1015 bytes} [Wed Feb 16 09:27:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:31.518674 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094251ad-dfd8-49b4-be8d-4783b035de7c service nova] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:31.521542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-094251ad-dfd8-49b4-be8d-4783b035de7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:31.556078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094251ad-dfd8-49b4-be8d-4783b035de7c service nova] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:31.584818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76abc2-5f4c-434d-b194-8406ff243ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:31.586196 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76abc2-5f4c-434d-b194-8406ff243ccf service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:31.588640 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76abc2-5f4c-434d-b194-8406ff243ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:31.588784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76abc2-5f4c-434d-b194-8406ff243ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:31.662985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76abc2-5f4c-434d-b194-8406ff243ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:31.664508 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76abc2-5f4c-434d-b194-8406ff243ccf service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:31.719837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 857/1701] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:27:33.002753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254886c-30ad-4e9f-98b1-543846cf1c89 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:33.004285 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254886c-30ad-4e9f-98b1-543846cf1c89 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:33.004863 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254886c-30ad-4e9f-98b1-543846cf1c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:33.025559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76abc2-5f4c-434d-b194-8406ff243ccf service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:33.026961 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9f76abc2-5f4c-434d-b194-8406ff243ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:33.064951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-f254886c-30ad-4e9f-98b1-543846cf1c89 None None] MFA Rules not processed for user `ff9ca3b6201b4f5780ccb309dc0440c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:33.069549 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f254886c-30ad-4e9f-98b1-543846cf1c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:33.092313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 845/1702] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:33.295683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76abc2-5f4c-434d-b194-8406ff243ccf service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:33.327428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:33.329247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:33.331883 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:33.332380 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] PATH_INFO: `/v3/users/6942b2411146441686440554bdaccf51` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:33.336918 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6942b2411146441686440554bdaccf51)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:33.338855 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:33.569397 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6942b2411146441686440554bdaccf51'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:33.640054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6942b2411146441686440554bdaccf51'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:33.646184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6942b2411146441686440554bdaccf51'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:33.689735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6942b2411146441686440554bdaccf51'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:33.770332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6942b2411146441686440554bdaccf51'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:33.800801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 858/1703] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:33 2022] DELETE /identity/v3/users/6942b2411146441686440554bdaccf51 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:33.804842 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7800a0-8fe2-4c25-be16-0b66cf7a0463 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:33.805463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7800a0-8fe2-4c25-be16-0b66cf7a0463 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:33.806109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7800a0-8fe2-4c25-be16-0b66cf7a0463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:33.851851 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-8b7800a0-8fe2-4c25-be16-0b66cf7a0463 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:33.858791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8b7800a0-8fe2-4c25-be16-0b66cf7a0463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:34.140398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 846/1704] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:34.217565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:34.222469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:34.502585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94f8c0-e88e-4b91-b6f5-0b3711af3bb6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:34.519306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74231e0-c711-488e-a79c-ab48ae1f70cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:34.538878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74231e0-c711-488e-a79c-ab48ae1f70cd service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:34.543740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74231e0-c711-488e-a79c-ab48ae1f70cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:34.543740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74231e0-c711-488e-a79c-ab48ae1f70cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:34.586399 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74231e0-c711-488e-a79c-ab48ae1f70cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:34.594845 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74231e0-c711-488e-a79c-ab48ae1f70cd service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:34.623392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 859/1705] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:35.730306 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd51f1b-d3d7-408e-8e35-4310ad8f9e64 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:35.730818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd51f1b-d3d7-408e-8e35-4310ad8f9e64 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:35.730897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd51f1b-d3d7-408e-8e35-4310ad8f9e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:35.771951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-2bd51f1b-d3d7-408e-8e35-4310ad8f9e64 None None] MFA Rules not processed for user `53dc4402074b44deb42d688bc302a58c`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:35.773952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2bd51f1b-d3d7-408e-8e35-4310ad8f9e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:35.912578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 847/1706] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:36.009587 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700a2b4-34bf-4246-a103-b7e88b69b67c None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:36.010084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700a2b4-34bf-4246-a103-b7e88b69b67c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:36.010184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700a2b4-34bf-4246-a103-b7e88b69b67c None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:36.020469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 860/1707] 10.222.0.90 () {54 vars in 921 bytes} [Wed Feb 16 09:27:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:27:36.031265 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb7f0a-040b-4410-9aa1-b1bafceb3904 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:36.032060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb7f0a-040b-4410-9aa1-b1bafceb3904 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:36.032538 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb7f0a-040b-4410-9aa1-b1bafceb3904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:36.056351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-45bb7f0a-040b-4410-9aa1-b1bafceb3904 None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:36.058916 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-45bb7f0a-040b-4410-9aa1-b1bafceb3904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:36.279771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 848/1708] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Feb 16 09:27:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:36.508310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700a2b4-34bf-4246-a103-b7e88b69b67c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:36.510743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e700a2b4-34bf-4246-a103-b7e88b69b67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:36.558353 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700a2b4-34bf-4246-a103-b7e88b69b67c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:36.567929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5a136-5ccc-4c89-8c79-c5d38713cc4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:36.572267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb7f0a-040b-4410-9aa1-b1bafceb3904 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:36.573739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-45bb7f0a-040b-4410-9aa1-b1bafceb3904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:36.573860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5a136-5ccc-4c89-8c79-c5d38713cc4f service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:36.574446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5a136-5ccc-4c89-8c79-c5d38713cc4f service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:36.575377 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5a136-5ccc-4c89-8c79-c5d38713cc4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:36.594045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5a136-5ccc-4c89-8c79-c5d38713cc4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:36.596476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5a136-5ccc-4c89-8c79-c5d38713cc4f service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:36.610436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb7f0a-040b-4410-9aa1-b1bafceb3904 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:36.621866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d02a9-8a36-463e-94d0-e346608251e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:36.623047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 861/1709] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:36.623781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d02a9-8a36-463e-94d0-e346608251e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:36.624088 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d02a9-8a36-463e-94d0-e346608251e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:36.624369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d02a9-8a36-463e-94d0-e346608251e7 admin admin] PATH_INFO: `/v3/projects/cce33e1c7dcf4526a346c95b806cca92` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:36.625680 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d02a9-8a36-463e-94d0-e346608251e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cce33e1c7dcf4526a346c95b806cca92)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:36.627766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d02a9-8a36-463e-94d0-e346608251e7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:36.730765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-916d02a9-8a36-463e-94d0-e346608251e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cce33e1c7dcf4526a346c95b806cca92', 'request_id': 'req-916d02a9-8a36-463e-94d0-e346608251e7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:36.762059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-916d02a9-8a36-463e-94d0-e346608251e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cce33e1c7dcf4526a346c95b806cca92', 'request_id': 'req-916d02a9-8a36-463e-94d0-e346608251e7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:36.798679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-916d02a9-8a36-463e-94d0-e346608251e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cce33e1c7dcf4526a346c95b806cca92', 'request_id': 'req-916d02a9-8a36-463e-94d0-e346608251e7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:36.845457 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-916d02a9-8a36-463e-94d0-e346608251e7 admin admin] The token cache is being invalidate because project cce33e1c7dcf4526a346c95b806cca92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:36.845937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-916d02a9-8a36-463e-94d0-e346608251e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:36.850241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-916d02a9-8a36-463e-94d0-e346608251e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:36.856505 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 849/1710] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:36 2022] DELETE /identity/v3/projects/cce33e1c7dcf4526a346c95b806cca92 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:36.858438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b26f4-168a-4ee5-9a30-d8a6de0517ac None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:36.859047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b26f4-168a-4ee5-9a30-d8a6de0517ac None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:36.859547 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b26f4-168a-4ee5-9a30-d8a6de0517ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:36.892070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-cc8b26f4-168a-4ee5-9a30-d8a6de0517ac None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:36.893954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-cc8b26f4-168a-4ee5-9a30-d8a6de0517ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:37.001663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 862/1711] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:37.001843 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e895d4-8d49-4140-a19c-bee8030e44d2 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:37.002397 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e895d4-8d49-4140-a19c-bee8030e44d2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:37.002701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e895d4-8d49-4140-a19c-bee8030e44d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:37.039956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-36e895d4-8d49-4140-a19c-bee8030e44d2 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:37.042355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-36e895d4-8d49-4140-a19c-bee8030e44d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:37.056867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 850/1712] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:37.059557 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b26f4-168a-4ee5-9a30-d8a6de0517ac None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:37.071408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b26f4-168a-4ee5-9a30-d8a6de0517ac None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:37.078565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4a03-e5f9-4cc5-9bbe-e63709e92a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:37.079372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4a03-e5f9-4cc5-9bbe-e63709e92a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:37.079709 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4a03-e5f9-4cc5-9bbe-e63709e92a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:37.080176 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4a03-e5f9-4cc5-9bbe-e63709e92a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:37.080925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca4a03-e5f9-4cc5-9bbe-e63709e92a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:37.081286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca4a03-e5f9-4cc5-9bbe-e63709e92a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:37.082918 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca4a03-e5f9-4cc5-9bbe-e63709e92a6e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:37.106239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 863/1713] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:37.107491 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e895d4-8d49-4140-a19c-bee8030e44d2 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:37.138567 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e895d4-8d49-4140-a19c-bee8030e44d2 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:37.154357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94320b82-5e71-4e84-abe6-9f00b99528f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:37.155440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94320b82-5e71-4e84-abe6-9f00b99528f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:37.155660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94320b82-5e71-4e84-abe6-9f00b99528f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:37.156075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94320b82-5e71-4e84-abe6-9f00b99528f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:37.161778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94320b82-5e71-4e84-abe6-9f00b99528f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:37.164480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94320b82-5e71-4e84-abe6-9f00b99528f3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:37.225822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 851/1714] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:37 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:27:37.230620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4a03-e5f9-4cc5-9bbe-e63709e92a6e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:37.254987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4a03-e5f9-4cc5-9bbe-e63709e92a6e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:37.434419 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b5e57-5433-4e8e-9208-eb7d671a186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:37.435798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b5e57-5433-4e8e-9208-eb7d671a186a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:37.436109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b5e57-5433-4e8e-9208-eb7d671a186a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:37.436407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b5e57-5433-4e8e-9208-eb7d671a186a admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:37.437203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b5e57-5433-4e8e-9208-eb7d671a186a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:37.449184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b5e57-5433-4e8e-9208-eb7d671a186a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:37.526162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 864/1715] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:37 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:37.530083 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94320b82-5e71-4e84-abe6-9f00b99528f3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:37.542202 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94320b82-5e71-4e84-abe6-9f00b99528f3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:37.558564 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f79bb7-9ad1-42fc-8736-ea40541e121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:37.559491 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f79bb7-9ad1-42fc-8736-ea40541e121c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:37.559961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f79bb7-9ad1-42fc-8736-ea40541e121c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:37.560453 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f79bb7-9ad1-42fc-8736-ea40541e121c admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:37.561523 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f79bb7-9ad1-42fc-8736-ea40541e121c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:37.563618 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f79bb7-9ad1-42fc-8736-ea40541e121c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:37.580433 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 852/1716] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:37.584337 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b5e57-5433-4e8e-9208-eb7d671a186a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:37.600062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b5e57-5433-4e8e-9208-eb7d671a186a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:37.608614 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba9e88-b389-49df-8826-1930e0a73635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:37.612981 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba9e88-b389-49df-8826-1930e0a73635 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:37.615124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba9e88-b389-49df-8826-1930e0a73635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:37.615874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba9e88-b389-49df-8826-1930e0a73635 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:37.618476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba9e88-b389-49df-8826-1930e0a73635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:37.624515 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba9e88-b389-49df-8826-1930e0a73635 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:37.659762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 865/1717] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:37.664262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f79bb7-9ad1-42fc-8736-ea40541e121c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:37.683342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f79bb7-9ad1-42fc-8736-ea40541e121c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:37.697952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2b496-1a32-4f97-b1f9-5d08696db3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:37.701210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2b496-1a32-4f97-b1f9-5d08696db3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:37.702394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2b496-1a32-4f97-b1f9-5d08696db3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:37.704254 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2b496-1a32-4f97-b1f9-5d08696db3e7 admin admin] PATH_INFO: `/v3/projects/2b08e18cd3fb49d1805b9c80733f52e9/users/89a6d6d54a604af29db11b3d9dede670/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:37.755254 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2b496-1a32-4f97-b1f9-5d08696db3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b08e18cd3fb49d1805b9c80733f52e9, user_id=89a6d6d54a604af29db11b3d9dede670, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:37.764006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2b496-1a32-4f97-b1f9-5d08696db3e7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:37.795627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 853/1718] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:37 2022] PUT /identity/v3/projects/2b08e18cd3fb49d1805b9c80733f52e9/users/89a6d6d54a604af29db11b3d9dede670/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:37.807442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cf8f2-c657-48b7-ba84-8ce654548403 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:37.807736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cf8f2-c657-48b7-ba84-8ce654548403 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:37.808016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cf8f2-c657-48b7-ba84-8ce654548403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:37.867555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6f9cf8f2-c657-48b7-ba84-8ce654548403 None None] MFA Rules not processed for user `89a6d6d54a604af29db11b3d9dede670`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:37.868830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6f9cf8f2-c657-48b7-ba84-8ce654548403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:38.008949 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 866/1719] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:38.013119 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2b496-1a32-4f97-b1f9-5d08696db3e7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:38.103152 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2b496-1a32-4f97-b1f9-5d08696db3e7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:38.108618 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d19cc1-9032-41bc-a1df-cb4a50042909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:38.109519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d19cc1-9032-41bc-a1df-cb4a50042909 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:38.109848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d19cc1-9032-41bc-a1df-cb4a50042909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:38.110226 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d19cc1-9032-41bc-a1df-cb4a50042909 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:38.110995 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d19cc1-9032-41bc-a1df-cb4a50042909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:38.113110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d19cc1-9032-41bc-a1df-cb4a50042909 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:38.153402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 854/1720] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:38 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:38.154930 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cf8f2-c657-48b7-ba84-8ce654548403 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:38.166849 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cf8f2-c657-48b7-ba84-8ce654548403 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:38.225889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6cf64-eede-40f3-ae64-b757b9bfd9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:38.226565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6cf64-eede-40f3-ae64-b757b9bfd9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:38.226846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6cf64-eede-40f3-ae64-b757b9bfd9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:38.227119 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d6cf64-eede-40f3-ae64-b757b9bfd9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:38.227821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6cf64-eede-40f3-ae64-b757b9bfd9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:38.229803 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d6cf64-eede-40f3-ae64-b757b9bfd9b9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:38.251070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 867/1721] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:38 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:38.254999 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d19cc1-9032-41bc-a1df-cb4a50042909 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:38.266977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d19cc1-9032-41bc-a1df-cb4a50042909 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:38.271757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b87ff6-e0d6-451b-a7c2-102fe6d57c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:38.272503 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b87ff6-e0d6-451b-a7c2-102fe6d57c2e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:38.272788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b87ff6-e0d6-451b-a7c2-102fe6d57c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:38.273174 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b87ff6-e0d6-451b-a7c2-102fe6d57c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:38.274321 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b87ff6-e0d6-451b-a7c2-102fe6d57c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:38.276508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b87ff6-e0d6-451b-a7c2-102fe6d57c2e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:38.332526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 855/1722] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:38.338036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6cf64-eede-40f3-ae64-b757b9bfd9b9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:38.350941 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d6cf64-eede-40f3-ae64-b757b9bfd9b9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:38.364760 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a0a33-66a5-45e7-b463-570cf3616b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:38.366717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a0a33-66a5-45e7-b463-570cf3616b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:38.367277 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a0a33-66a5-45e7-b463-570cf3616b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:38.367791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a0a33-66a5-45e7-b463-570cf3616b07 admin admin] PATH_INFO: `/v3/projects/13264b4695f34f4589cc71881176569b/users/75feb4b869284b99ba91d5c7204ac362/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:38.391706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a0a33-66a5-45e7-b463-570cf3616b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13264b4695f34f4589cc71881176569b, user_id=75feb4b869284b99ba91d5c7204ac362, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:38.396849 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a0a33-66a5-45e7-b463-570cf3616b07 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:38.418121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 868/1723] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:38 2022] PUT /identity/v3/projects/13264b4695f34f4589cc71881176569b/users/75feb4b869284b99ba91d5c7204ac362/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:38.422311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b87ff6-e0d6-451b-a7c2-102fe6d57c2e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:38.435634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b87ff6-e0d6-451b-a7c2-102fe6d57c2e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:38.502651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbbf4b3-da5e-477c-9668-d1150f511372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:38.503536 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf4b3-da5e-477c-9668-d1150f511372 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:38.503822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf4b3-da5e-477c-9668-d1150f511372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:38.504128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbbf4b3-da5e-477c-9668-d1150f511372 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:38.504909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbf4b3-da5e-477c-9668-d1150f511372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:38.506495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbbf4b3-da5e-477c-9668-d1150f511372 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:38.522157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 856/1724] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:38.523852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a0a33-66a5-45e7-b463-570cf3616b07 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:38.572368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a0a33-66a5-45e7-b463-570cf3616b07 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:38.592083 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20484901-8d75-4436-97c3-0889e401aab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:38.596410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20484901-8d75-4436-97c3-0889e401aab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:38.597144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20484901-8d75-4436-97c3-0889e401aab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:38.598349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20484901-8d75-4436-97c3-0889e401aab0 admin admin] PATH_INFO: `/v3/projects/13264b4695f34f4589cc71881176569b/users/75feb4b869284b99ba91d5c7204ac362/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:38.602538 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20484901-8d75-4436-97c3-0889e401aab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13264b4695f34f4589cc71881176569b, user_id=75feb4b869284b99ba91d5c7204ac362, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:38.609354 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20484901-8d75-4436-97c3-0889e401aab0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:38.640081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 869/1725] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:38 2022] PUT /identity/v3/projects/13264b4695f34f4589cc71881176569b/users/75feb4b869284b99ba91d5c7204ac362/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:38.652391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f4b3e-0ac0-4e77-a6f8-7da378737bc5 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:38.652677 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f4b3e-0ac0-4e77-a6f8-7da378737bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:38.652955 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f4b3e-0ac0-4e77-a6f8-7da378737bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:38.701751 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-8d9f4b3e-0ac0-4e77-a6f8-7da378737bc5 None None] MFA Rules not processed for user `75feb4b869284b99ba91d5c7204ac362`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:38.704364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8d9f4b3e-0ac0-4e77-a6f8-7da378737bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:38.815980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 857/1726] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:38.833796 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20484901-8d75-4436-97c3-0889e401aab0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:38.835937 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-20484901-8d75-4436-97c3-0889e401aab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:38.917619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20484901-8d75-4436-97c3-0889e401aab0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:38.921420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae039015-eee2-4046-ba17-bd7f16902e7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:38.922281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae039015-eee2-4046-ba17-bd7f16902e7b service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:38.922583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae039015-eee2-4046-ba17-bd7f16902e7b service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:38.922856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae039015-eee2-4046-ba17-bd7f16902e7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:38.933131 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae039015-eee2-4046-ba17-bd7f16902e7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:38.934595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae039015-eee2-4046-ba17-bd7f16902e7b service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:38.947243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 870/1727] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:39.113421 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f4b3e-0ac0-4e77-a6f8-7da378737bc5 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:39.151520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f4b3e-0ac0-4e77-a6f8-7da378737bc5 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:39.161442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35a39b-5ec7-4a0a-b536-24d5e9811ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:39.163233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35a39b-5ec7-4a0a-b536-24d5e9811ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:39.167068 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35a39b-5ec7-4a0a-b536-24d5e9811ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:39.167508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35a39b-5ec7-4a0a-b536-24d5e9811ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:39.337353 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35a39b-5ec7-4a0a-b536-24d5e9811ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:39.338847 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35a39b-5ec7-4a0a-b536-24d5e9811ea6 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:39.356595 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 858/1728] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:43.231308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae039015-eee2-4046-ba17-bd7f16902e7b service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:43.294520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae039015-eee2-4046-ba17-bd7f16902e7b service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:43.301026 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:43.301890 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:43.302174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:43.302481 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] PATH_INFO: `/v3/users/89a6d6d54a604af29db11b3d9dede670` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:43.304007 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a6d6d54a604af29db11b3d9dede670)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:43.306440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:43.353753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a6d6d54a604af29db11b3d9dede670'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:43.365904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a6d6d54a604af29db11b3d9dede670'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:43.366772 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a6d6d54a604af29db11b3d9dede670'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:43.377579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a6d6d54a604af29db11b3d9dede670'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:43.385149 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a6d6d54a604af29db11b3d9dede670'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:43.391618 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 871/1729] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:43 2022] DELETE /identity/v3/users/89a6d6d54a604af29db11b3d9dede670 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:43.396174 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc8619-9d3c-4dd5-8bac-7b1071e2df4f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:43.396713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc8619-9d3c-4dd5-8bac-7b1071e2df4f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:43.396713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc8619-9d3c-4dd5-8bac-7b1071e2df4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:43.416712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-c8dc8619-9d3c-4dd5-8bac-7b1071e2df4f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:43.417931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c8dc8619-9d3c-4dd5-8bac-7b1071e2df4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:43.481835 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 859/1730] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:43.493003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:43.494472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:43.563995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717d48-1e5e-4275-8ccd-9a87ba10d04f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:43.567920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc17e9e-7a66-4d88-96d5-85dc943e116d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:43.568595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc17e9e-7a66-4d88-96d5-85dc943e116d service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:43.568876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc17e9e-7a66-4d88-96d5-85dc943e116d service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:43.569166 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc17e9e-7a66-4d88-96d5-85dc943e116d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:43.591521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc17e9e-7a66-4d88-96d5-85dc943e116d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:43.593013 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc17e9e-7a66-4d88-96d5-85dc943e116d service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:43.604106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 872/1731] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:43.877593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc8619-9d3c-4dd5-8bac-7b1071e2df4f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:43.879026 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c8dc8619-9d3c-4dd5-8bac-7b1071e2df4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:43.892160 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc8619-9d3c-4dd5-8bac-7b1071e2df4f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:43.905194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:43.906162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:43.906432 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:43.906709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] PATH_INFO: `/v3/projects/2b08e18cd3fb49d1805b9c80733f52e9` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:43.907966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b08e18cd3fb49d1805b9c80733f52e9)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:43.909942 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:43.958434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b08e18cd3fb49d1805b9c80733f52e9', 'request_id': 'req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:43.963776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b08e18cd3fb49d1805b9c80733f52e9', 'request_id': 'req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:43.970176 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b08e18cd3fb49d1805b9c80733f52e9', 'request_id': 'req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:43.983022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] The token cache is being invalidate because project 2b08e18cd3fb49d1805b9c80733f52e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:43.983308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:43.984486 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:43.986054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 860/1732] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:43 2022] DELETE /identity/v3/projects/2b08e18cd3fb49d1805b9c80733f52e9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:43.989965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc17e9e-7a66-4d88-96d5-85dc943e116d service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:43.999259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc17e9e-7a66-4d88-96d5-85dc943e116d service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:44.056377 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b344d-bc08-4621-a5ad-f46058fefbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:44.057240 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b344d-bc08-4621-a5ad-f46058fefbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:44.057518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b344d-bc08-4621-a5ad-f46058fefbee admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:44.057792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b344d-bc08-4621-a5ad-f46058fefbee admin admin] PATH_INFO: `/v3/users/75feb4b869284b99ba91d5c7204ac362` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:44.058976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b344d-bc08-4621-a5ad-f46058fefbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=75feb4b869284b99ba91d5c7204ac362)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:44.060922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b344d-bc08-4621-a5ad-f46058fefbee admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:44.104186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-619b344d-bc08-4621-a5ad-f46058fefbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75feb4b869284b99ba91d5c7204ac362'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:44.115886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-619b344d-bc08-4621-a5ad-f46058fefbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75feb4b869284b99ba91d5c7204ac362'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:44.116582 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-619b344d-bc08-4621-a5ad-f46058fefbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75feb4b869284b99ba91d5c7204ac362'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:44.123625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-619b344d-bc08-4621-a5ad-f46058fefbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75feb4b869284b99ba91d5c7204ac362'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:44.130720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-619b344d-bc08-4621-a5ad-f46058fefbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75feb4b869284b99ba91d5c7204ac362'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:44.136488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 873/1733] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:43 2022] DELETE /identity/v3/users/75feb4b869284b99ba91d5c7204ac362 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:27:44.430991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:44.432756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:44.460232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d8e0c-ab0b-4340-bb64-3425baada3e1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:44.549533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961d17b-e2bc-46da-8675-10661afaa9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:44.550411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961d17b-e2bc-46da-8675-10661afaa9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:44.551515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961d17b-e2bc-46da-8675-10661afaa9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:44.551893 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961d17b-e2bc-46da-8675-10661afaa9e3 admin admin] PATH_INFO: `/v3/projects/13264b4695f34f4589cc71881176569b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:44.553392 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961d17b-e2bc-46da-8675-10661afaa9e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13264b4695f34f4589cc71881176569b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:44.568979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961d17b-e2bc-46da-8675-10661afaa9e3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:44.719931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f961d17b-e2bc-46da-8675-10661afaa9e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13264b4695f34f4589cc71881176569b', 'request_id': 'req-f961d17b-e2bc-46da-8675-10661afaa9e3'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:44.745281 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f961d17b-e2bc-46da-8675-10661afaa9e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13264b4695f34f4589cc71881176569b', 'request_id': 'req-f961d17b-e2bc-46da-8675-10661afaa9e3'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:44.764157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f961d17b-e2bc-46da-8675-10661afaa9e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13264b4695f34f4589cc71881176569b', 'request_id': 'req-f961d17b-e2bc-46da-8675-10661afaa9e3'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:44.806293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f961d17b-e2bc-46da-8675-10661afaa9e3 admin admin] The token cache is being invalidate because project 13264b4695f34f4589cc71881176569b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:44.806603 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f961d17b-e2bc-46da-8675-10661afaa9e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:44.810356 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f961d17b-e2bc-46da-8675-10661afaa9e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:44.823193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 861/1734] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:44 2022] DELETE /identity/v3/projects/13264b4695f34f4589cc71881176569b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:44.825322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dee717-c4d7-4f8a-b8ea-5fd43cae0f53 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:44.825770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dee717-c4d7-4f8a-b8ea-5fd43cae0f53 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:44.825962 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dee717-c4d7-4f8a-b8ea-5fd43cae0f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:44.863444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b5dee717-c4d7-4f8a-b8ea-5fd43cae0f53 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:44.866155 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b5dee717-c4d7-4f8a-b8ea-5fd43cae0f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:45.024790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f57f1-e812-40cb-a8af-019876446c7b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:45.025009 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f57f1-e812-40cb-a8af-019876446c7b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:45.026058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f57f1-e812-40cb-a8af-019876446c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:45.027311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 874/1735] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:45.065369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-667f57f1-e812-40cb-a8af-019876446c7b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:45.065369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-667f57f1-e812-40cb-a8af-019876446c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:45.090551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 862/1736] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:45.092710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dee717-c4d7-4f8a-b8ea-5fd43cae0f53 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:45.110020 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dee717-c4d7-4f8a-b8ea-5fd43cae0f53 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:45.119603 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00451c-f904-4acf-a31f-e9bc267dcc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:45.121271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00451c-f904-4acf-a31f-e9bc267dcc2c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:45.121658 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00451c-f904-4acf-a31f-e9bc267dcc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:45.131541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00451c-f904-4acf-a31f-e9bc267dcc2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:45.132646 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00451c-f904-4acf-a31f-e9bc267dcc2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:45.133622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00451c-f904-4acf-a31f-e9bc267dcc2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:45.138802 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00451c-f904-4acf-a31f-e9bc267dcc2c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:45.191792 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f57f1-e812-40cb-a8af-019876446c7b None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:45.198793 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 875/1737] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:45.204400 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f57f1-e812-40cb-a8af-019876446c7b None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:45.218110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152308a9-3654-4f60-9222-34b150b52fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:45.220957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152308a9-3654-4f60-9222-34b150b52fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:45.222969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152308a9-3654-4f60-9222-34b150b52fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:45.223471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152308a9-3654-4f60-9222-34b150b52fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:45.225032 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152308a9-3654-4f60-9222-34b150b52fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:45.236222 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152308a9-3654-4f60-9222-34b150b52fe8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:45.299548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 863/1738] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:45 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:45.303917 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00451c-f904-4acf-a31f-e9bc267dcc2c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:45.320176 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00451c-f904-4acf-a31f-e9bc267dcc2c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:45.412580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5b919-86d1-422f-ad71-18ba2409c6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:45.415477 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5b919-86d1-422f-ad71-18ba2409c6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:45.415623 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5b919-86d1-422f-ad71-18ba2409c6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:45.416991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5b919-86d1-422f-ad71-18ba2409c6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:45.417787 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5b919-86d1-422f-ad71-18ba2409c6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:45.420736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5b919-86d1-422f-ad71-18ba2409c6e2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:45.463934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 876/1739] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:45 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:45.469625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152308a9-3654-4f60-9222-34b150b52fe8 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:45.488320 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152308a9-3654-4f60-9222-34b150b52fe8 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:45.494425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67dc57-c111-4088-b393-7612c033fba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:45.495130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67dc57-c111-4088-b393-7612c033fba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:45.495480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67dc57-c111-4088-b393-7612c033fba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:45.496692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67dc57-c111-4088-b393-7612c033fba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:45.497673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67dc57-c111-4088-b393-7612c033fba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:45.500969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67dc57-c111-4088-b393-7612c033fba0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:45.515622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 864/1740] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:27:45.519595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5b919-86d1-422f-ad71-18ba2409c6e2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:45.537287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5b919-86d1-422f-ad71-18ba2409c6e2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:45.553907 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8f546-b5e5-4de3-b9bc-c2f7e30d39da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:45.554831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8f546-b5e5-4de3-b9bc-c2f7e30d39da admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:45.555187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8f546-b5e5-4de3-b9bc-c2f7e30d39da admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:45.556045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8f546-b5e5-4de3-b9bc-c2f7e30d39da admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:45.556871 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8f546-b5e5-4de3-b9bc-c2f7e30d39da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:45.563705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8f546-b5e5-4de3-b9bc-c2f7e30d39da admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:45.589996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 877/1741] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:45.594686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67dc57-c111-4088-b393-7612c033fba0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:45.618049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67dc57-c111-4088-b393-7612c033fba0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:45.624625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efba79-9f37-4484-be10-b2d9e55cc156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:45.627081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efba79-9f37-4484-be10-b2d9e55cc156 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:45.628604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efba79-9f37-4484-be10-b2d9e55cc156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:45.629144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efba79-9f37-4484-be10-b2d9e55cc156 admin admin] PATH_INFO: `/v3/projects/dbaca57402a446bf8f32e8a81f0acb3e/users/56dcd2e28f6e402db8f068e13f6095b4/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:45.653778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efba79-9f37-4484-be10-b2d9e55cc156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbaca57402a446bf8f32e8a81f0acb3e, user_id=56dcd2e28f6e402db8f068e13f6095b4, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:45.658241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efba79-9f37-4484-be10-b2d9e55cc156 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:45.682725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 865/1742] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:45 2022] PUT /identity/v3/projects/dbaca57402a446bf8f32e8a81f0acb3e/users/56dcd2e28f6e402db8f068e13f6095b4/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:45.694272 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25f27d-580b-4a21-8797-6dc943200229 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:45.694559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25f27d-580b-4a21-8797-6dc943200229 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:45.694829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25f27d-580b-4a21-8797-6dc943200229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:45.754571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2a25f27d-580b-4a21-8797-6dc943200229 None None] MFA Rules not processed for user `56dcd2e28f6e402db8f068e13f6095b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:45.761604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2a25f27d-580b-4a21-8797-6dc943200229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:45.899913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 878/1743] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:45.901855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efba79-9f37-4484-be10-b2d9e55cc156 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:46.035281 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efba79-9f37-4484-be10-b2d9e55cc156 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:46.043092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee56799-dcf5-4414-9187-a0babdbe1d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:46.043963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee56799-dcf5-4414-9187-a0babdbe1d95 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:46.044342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee56799-dcf5-4414-9187-a0babdbe1d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:46.045163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee56799-dcf5-4414-9187-a0babdbe1d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:46.045444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee56799-dcf5-4414-9187-a0babdbe1d95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:46.047721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee56799-dcf5-4414-9187-a0babdbe1d95 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:46.083969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 866/1744] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:45 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:27:46.087990 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25f27d-580b-4a21-8797-6dc943200229 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:46.099174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25f27d-580b-4a21-8797-6dc943200229 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:46.171935 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30b7a-6b62-45a1-b022-921045ce021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:46.172721 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30b7a-6b62-45a1-b022-921045ce021a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:46.173003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30b7a-6b62-45a1-b022-921045ce021a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:46.173287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b30b7a-6b62-45a1-b022-921045ce021a admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:46.174325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b30b7a-6b62-45a1-b022-921045ce021a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:46.176370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b30b7a-6b62-45a1-b022-921045ce021a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:46.203452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 879/1745] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:46 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:27:46.204869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee56799-dcf5-4414-9187-a0babdbe1d95 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:46.215979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee56799-dcf5-4414-9187-a0babdbe1d95 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:46.221112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce400fe-ef88-4392-953a-e82b57cebdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:46.221896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce400fe-ef88-4392-953a-e82b57cebdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:46.222251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce400fe-ef88-4392-953a-e82b57cebdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:46.222601 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce400fe-ef88-4392-953a-e82b57cebdc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:46.223472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce400fe-ef88-4392-953a-e82b57cebdc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:46.225307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce400fe-ef88-4392-953a-e82b57cebdc4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:46.238302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 867/1746] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:46.242734 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30b7a-6b62-45a1-b022-921045ce021a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:46.254416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b30b7a-6b62-45a1-b022-921045ce021a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:46.259631 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82295881-e920-4b46-8cdd-9a9c8aed7cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:46.260418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82295881-e920-4b46-8cdd-9a9c8aed7cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:46.260695 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82295881-e920-4b46-8cdd-9a9c8aed7cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:46.260963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82295881-e920-4b46-8cdd-9a9c8aed7cf5 admin admin] PATH_INFO: `/v3/projects/9c9ba4a489fb48c18aa346a5cd0ab909/users/52796b0944fd4e3d9bda5e7a24ffa27e/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:46.293147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82295881-e920-4b46-8cdd-9a9c8aed7cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9ba4a489fb48c18aa346a5cd0ab909, user_id=52796b0944fd4e3d9bda5e7a24ffa27e, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:46.295804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82295881-e920-4b46-8cdd-9a9c8aed7cf5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:46.311418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 880/1747] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:46 2022] PUT /identity/v3/projects/9c9ba4a489fb48c18aa346a5cd0ab909/users/52796b0944fd4e3d9bda5e7a24ffa27e/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:46.315446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce400fe-ef88-4392-953a-e82b57cebdc4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:46.325297 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce400fe-ef88-4392-953a-e82b57cebdc4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:46.396287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f134d20-327f-4685-940b-3afaa55d2321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:46.397139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f134d20-327f-4685-940b-3afaa55d2321 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:46.397752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f134d20-327f-4685-940b-3afaa55d2321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:46.398220 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f134d20-327f-4685-940b-3afaa55d2321 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:46.399151 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f134d20-327f-4685-940b-3afaa55d2321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:46.401409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f134d20-327f-4685-940b-3afaa55d2321 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:46.414339 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 868/1748] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:27:46.418587 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82295881-e920-4b46-8cdd-9a9c8aed7cf5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:46.431013 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82295881-e920-4b46-8cdd-9a9c8aed7cf5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:46.435632 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64a62a-1161-42d5-b8ed-c1f644940e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:46.436557 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64a62a-1161-42d5-b8ed-c1f644940e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:46.436842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64a62a-1161-42d5-b8ed-c1f644940e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:46.437167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64a62a-1161-42d5-b8ed-c1f644940e19 admin admin] PATH_INFO: `/v3/projects/9c9ba4a489fb48c18aa346a5cd0ab909/users/52796b0944fd4e3d9bda5e7a24ffa27e/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:46.439408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64a62a-1161-42d5-b8ed-c1f644940e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9ba4a489fb48c18aa346a5cd0ab909, user_id=52796b0944fd4e3d9bda5e7a24ffa27e, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:46.442081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64a62a-1161-42d5-b8ed-c1f644940e19 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:46.453295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 881/1749] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:46 2022] PUT /identity/v3/projects/9c9ba4a489fb48c18aa346a5cd0ab909/users/52796b0944fd4e3d9bda5e7a24ffa27e/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:46.463687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b93bc0-d481-4e7b-bdc9-4edf83107628 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:46.464197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b93bc0-d481-4e7b-bdc9-4edf83107628 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:46.464641 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b93bc0-d481-4e7b-bdc9-4edf83107628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:46.507776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a2b93bc0-d481-4e7b-bdc9-4edf83107628 None None] MFA Rules not processed for user `52796b0944fd4e3d9bda5e7a24ffa27e`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:46.509027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a2b93bc0-d481-4e7b-bdc9-4edf83107628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:46.542858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f918-aafa-4d04-a3cf-f2c3c59b8f59 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:46.543156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f918-aafa-4d04-a3cf-f2c3c59b8f59 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:46.543416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034f918-aafa-4d04-a3cf-f2c3c59b8f59 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:46.545718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 882/1750] 10.222.0.90 () {54 vars in 921 bytes} [Wed Feb 16 09:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:27:46.551746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9424d4-10d1-4869-8ea2-4d84eba2e133 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:46.552055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9424d4-10d1-4869-8ea2-4d84eba2e133 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:46.552351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9424d4-10d1-4869-8ea2-4d84eba2e133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:46.579383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-fc9424d4-10d1-4869-8ea2-4d84eba2e133 None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:46.580395 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fc9424d4-10d1-4869-8ea2-4d84eba2e133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:46.621805 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 869/1751] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:46.658957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b93bc0-d481-4e7b-bdc9-4edf83107628 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:46.660425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a2b93bc0-d481-4e7b-bdc9-4edf83107628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:46.685165 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 883/1752] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Feb 16 09:27:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:46.705107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9424d4-10d1-4869-8ea2-4d84eba2e133 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:46.706791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fc9424d4-10d1-4869-8ea2-4d84eba2e133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:46.724486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9424d4-10d1-4869-8ea2-4d84eba2e133 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:46.730827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201af7c7-3407-4160-90d8-6225a351b6c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:46.731568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201af7c7-3407-4160-90d8-6225a351b6c1 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:46.731917 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201af7c7-3407-4160-90d8-6225a351b6c1 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:46.732299 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201af7c7-3407-4160-90d8-6225a351b6c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:46.738519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b93bc0-d481-4e7b-bdc9-4edf83107628 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:46.742804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201af7c7-3407-4160-90d8-6225a351b6c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:46.743632 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351c8b7-28f4-4e13-a14c-1bbc3ee6b8de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:46.744408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351c8b7-28f4-4e13-a14c-1bbc3ee6b8de service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:46.744644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201af7c7-3407-4160-90d8-6225a351b6c1 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:46.744884 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351c8b7-28f4-4e13-a14c-1bbc3ee6b8de service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:46.745161 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351c8b7-28f4-4e13-a14c-1bbc3ee6b8de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:46.756164 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351c8b7-28f4-4e13-a14c-1bbc3ee6b8de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:46.757707 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351c8b7-28f4-4e13-a14c-1bbc3ee6b8de service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:46.758567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 884/1753] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:27:46.770396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 870/1754] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:46.828925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201af7c7-3407-4160-90d8-6225a351b6c1 service nova] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:46.909150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201af7c7-3407-4160-90d8-6225a351b6c1 service nova] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:46.919446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:46.920352 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:46.920629 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:46.920946 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] PATH_INFO: `/v3/users/56dcd2e28f6e402db8f068e13f6095b4` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:46.922964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dcd2e28f6e402db8f068e13f6095b4)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:46.924957 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:46.988926 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dcd2e28f6e402db8f068e13f6095b4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.005244 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dcd2e28f6e402db8f068e13f6095b4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.005987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dcd2e28f6e402db8f068e13f6095b4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.025785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dcd2e28f6e402db8f068e13f6095b4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.041626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dcd2e28f6e402db8f068e13f6095b4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.048723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 885/1755] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:46 2022] DELETE /identity/v3/users/56dcd2e28f6e402db8f068e13f6095b4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:27:47.054880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35e29-0555-4d82-9ef8-aafd89ea409d None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:47.055350 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35e29-0555-4d82-9ef8-aafd89ea409d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:47.055805 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a35e29-0555-4d82-9ef8-aafd89ea409d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:47.090613 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-53a35e29-0555-4d82-9ef8-aafd89ea409d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:47.091745 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-53a35e29-0555-4d82-9ef8-aafd89ea409d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:47.158506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 871/1756] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:47.171873 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:47.171873 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:47.226813 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb557cc-8109-4ef5-b5ce-3c2d12c6b529 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:47.230749 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1d46-1231-4e4b-bb95-842992af31f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:47.231399 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1d46-1231-4e4b-bb95-842992af31f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:47.231684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1d46-1231-4e4b-bb95-842992af31f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:47.231961 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b1d46-1231-4e4b-bb95-842992af31f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:47.241705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b1d46-1231-4e4b-bb95-842992af31f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:47.243151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b1d46-1231-4e4b-bb95-842992af31f1 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:47.253376 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 886/1757] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:47.517633 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35e29-0555-4d82-9ef8-aafd89ea409d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:47.519188 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-53a35e29-0555-4d82-9ef8-aafd89ea409d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:47.533119 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a35e29-0555-4d82-9ef8-aafd89ea409d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:47.537875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:47.538753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:47.539033 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:47.539305 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] PATH_INFO: `/v3/projects/dbaca57402a446bf8f32e8a81f0acb3e` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:47.540555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbaca57402a446bf8f32e8a81f0acb3e)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:47.542477 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:47.590820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbaca57402a446bf8f32e8a81f0acb3e', 'request_id': 'req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.596424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbaca57402a446bf8f32e8a81f0acb3e', 'request_id': 'req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.602303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbaca57402a446bf8f32e8a81f0acb3e', 'request_id': 'req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.614769 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] The token cache is being invalidate because project dbaca57402a446bf8f32e8a81f0acb3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:47.615054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.615679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.617233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 872/1758] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:47 2022] DELETE /identity/v3/projects/dbaca57402a446bf8f32e8a81f0acb3e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:47.621301 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1d46-1231-4e4b-bb95-842992af31f1 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:47.631311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b1d46-1231-4e4b-bb95-842992af31f1 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:47.684893 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccf1e7-2521-49b0-8c6d-ca8ffeddc76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:47.685755 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccf1e7-2521-49b0-8c6d-ca8ffeddc76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:47.686038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccf1e7-2521-49b0-8c6d-ca8ffeddc76d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:47.686315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccf1e7-2521-49b0-8c6d-ca8ffeddc76d admin admin] PATH_INFO: `/v3/users/52796b0944fd4e3d9bda5e7a24ffa27e` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:47.688978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccf1e7-2521-49b0-8c6d-ca8ffeddc76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=52796b0944fd4e3d9bda5e7a24ffa27e)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:47.690905 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccf1e7-2521-49b0-8c6d-ca8ffeddc76d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:47.741172 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ccccf1e7-2521-49b0-8c6d-ca8ffeddc76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52796b0944fd4e3d9bda5e7a24ffa27e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.753806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ccccf1e7-2521-49b0-8c6d-ca8ffeddc76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52796b0944fd4e3d9bda5e7a24ffa27e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.754522 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ccccf1e7-2521-49b0-8c6d-ca8ffeddc76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52796b0944fd4e3d9bda5e7a24ffa27e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.763276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ccccf1e7-2521-49b0-8c6d-ca8ffeddc76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52796b0944fd4e3d9bda5e7a24ffa27e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.770017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ccccf1e7-2521-49b0-8c6d-ca8ffeddc76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52796b0944fd4e3d9bda5e7a24ffa27e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:47.776002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 887/1759] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:47 2022] DELETE /identity/v3/users/52796b0944fd4e3d9bda5e7a24ffa27e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:48.076694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:48.078194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:48.090961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3cd3b-b1c0-4bcd-bed7-95ebe53c2c58 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:48.173237 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4ace0-1b89-47bf-a184-6b7262bc0574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:48.174241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4ace0-1b89-47bf-a184-6b7262bc0574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.174519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4ace0-1b89-47bf-a184-6b7262bc0574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.174793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4ace0-1b89-47bf-a184-6b7262bc0574 admin admin] PATH_INFO: `/v3/projects/9c9ba4a489fb48c18aa346a5cd0ab909` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.176143 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4ace0-1b89-47bf-a184-6b7262bc0574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c9ba4a489fb48c18aa346a5cd0ab909)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:48.178061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4ace0-1b89-47bf-a184-6b7262bc0574 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:48.230730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5ab4ace0-1b89-47bf-a184-6b7262bc0574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9ba4a489fb48c18aa346a5cd0ab909', 'request_id': 'req-5ab4ace0-1b89-47bf-a184-6b7262bc0574'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:48.236517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5ab4ace0-1b89-47bf-a184-6b7262bc0574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9ba4a489fb48c18aa346a5cd0ab909', 'request_id': 'req-5ab4ace0-1b89-47bf-a184-6b7262bc0574'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:48.242763 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5ab4ace0-1b89-47bf-a184-6b7262bc0574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9ba4a489fb48c18aa346a5cd0ab909', 'request_id': 'req-5ab4ace0-1b89-47bf-a184-6b7262bc0574'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:48.259617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5ab4ace0-1b89-47bf-a184-6b7262bc0574 admin admin] The token cache is being invalidate because project 9c9ba4a489fb48c18aa346a5cd0ab909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:48.259909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5ab4ace0-1b89-47bf-a184-6b7262bc0574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:48.260614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5ab4ace0-1b89-47bf-a184-6b7262bc0574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:48.262681 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 873/1760] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:48 2022] DELETE /identity/v3/projects/9c9ba4a489fb48c18aa346a5cd0ab909 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:48.267991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ba6b-74a3-4d23-b7e9-d83ccbd606f5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.268476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ba6b-74a3-4d23-b7e9-d83ccbd606f5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.268636 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ba6b-74a3-4d23-b7e9-d83ccbd606f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.287785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6663ba6b-74a3-4d23-b7e9-d83ccbd606f5 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:48.289052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6663ba6b-74a3-4d23-b7e9-d83ccbd606f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:48.356387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 888/1761] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:48.358196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063724-169c-40d1-9748-77ce15f1585a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.358486 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063724-169c-40d1-9748-77ce15f1585a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.358770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063724-169c-40d1-9748-77ce15f1585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.377717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-04063724-169c-40d1-9748-77ce15f1585a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:48.378917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-04063724-169c-40d1-9748-77ce15f1585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:48.386826 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 874/1762] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:48.392078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663ba6b-74a3-4d23-b7e9-d83ccbd606f5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:48.401737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663ba6b-74a3-4d23-b7e9-d83ccbd606f5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:48.407044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca04a8-bf16-4285-852a-9811d68bbe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:48.407824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca04a8-bf16-4285-852a-9811d68bbe41 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.408192 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca04a8-bf16-4285-852a-9811d68bbe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.408472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca04a8-bf16-4285-852a-9811d68bbe41 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.409191 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca04a8-bf16-4285-852a-9811d68bbe41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:48.409544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca04a8-bf16-4285-852a-9811d68bbe41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:48.411289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca04a8-bf16-4285-852a-9811d68bbe41 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:48.423369 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 889/1763] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:48.427668 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063724-169c-40d1-9748-77ce15f1585a None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:48.436803 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063724-169c-40d1-9748-77ce15f1585a None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:48.442447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a8baa-c01f-41b4-8e36-dc041b01ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:48.443088 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a8baa-c01f-41b4-8e36-dc041b01ba73 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.443370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a8baa-c01f-41b4-8e36-dc041b01ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.443640 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a8baa-c01f-41b4-8e36-dc041b01ba73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.444374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a8baa-c01f-41b4-8e36-dc041b01ba73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:48.446255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a8baa-c01f-41b4-8e36-dc041b01ba73 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:48.471783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 875/1764] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:48 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:48.475850 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca04a8-bf16-4285-852a-9811d68bbe41 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:48.486520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca04a8-bf16-4285-852a-9811d68bbe41 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:48.541043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15e017-3c8c-4a3a-a404-5e48e4c622a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:48.541631 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15e017-3c8c-4a3a-a404-5e48e4c622a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.541910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15e017-3c8c-4a3a-a404-5e48e4c622a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.542183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15e017-3c8c-4a3a-a404-5e48e4c622a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.542866 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15e017-3c8c-4a3a-a404-5e48e4c622a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:48.544816 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf15e017-3c8c-4a3a-a404-5e48e4c622a2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:48.565775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 890/1765] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:48 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:27:48.569919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a8baa-c01f-41b4-8e36-dc041b01ba73 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:48.580430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a8baa-c01f-41b4-8e36-dc041b01ba73 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:48.585004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ae2dc-2dd5-4e22-9727-3a4a36cb527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:48.585653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ae2dc-2dd5-4e22-9727-3a4a36cb527a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.585931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ae2dc-2dd5-4e22-9727-3a4a36cb527a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.586201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ae2dc-2dd5-4e22-9727-3a4a36cb527a admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.586903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ae2dc-2dd5-4e22-9727-3a4a36cb527a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:48.588518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ae2dc-2dd5-4e22-9727-3a4a36cb527a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:48.598581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 876/1766] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:48.602376 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15e017-3c8c-4a3a-a404-5e48e4c622a2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:48.613195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf15e017-3c8c-4a3a-a404-5e48e4c622a2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:48.617825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455da8f-ac23-44e2-a5a9-de004ecd60b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:48.618473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455da8f-ac23-44e2-a5a9-de004ecd60b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.618758 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455da8f-ac23-44e2-a5a9-de004ecd60b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.619032 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455da8f-ac23-44e2-a5a9-de004ecd60b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.619747 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455da8f-ac23-44e2-a5a9-de004ecd60b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:48.621351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455da8f-ac23-44e2-a5a9-de004ecd60b8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:48.632269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 891/1767] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:27:48.636176 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ae2dc-2dd5-4e22-9727-3a4a36cb527a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:48.646223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ae2dc-2dd5-4e22-9727-3a4a36cb527a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:48.651287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0365dd-4332-4249-a833-a540ee4b2284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:48.652201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0365dd-4332-4249-a833-a540ee4b2284 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.652479 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0365dd-4332-4249-a833-a540ee4b2284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.652755 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0365dd-4332-4249-a833-a540ee4b2284 admin admin] PATH_INFO: `/v3/projects/7380430f8a6d481cb1a22bc124c50289/users/5c08e5cbde29434bbf59d22731d3ced9/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.667815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0365dd-4332-4249-a833-a540ee4b2284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7380430f8a6d481cb1a22bc124c50289, user_id=5c08e5cbde29434bbf59d22731d3ced9, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:48.670506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0365dd-4332-4249-a833-a540ee4b2284 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:48.683859 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 877/1768] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:48 2022] PUT /identity/v3/projects/7380430f8a6d481cb1a22bc124c50289/users/5c08e5cbde29434bbf59d22731d3ced9/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:48.695531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c97c85-1b78-4761-85f4-9f8f39fa268c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.695826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c97c85-1b78-4761-85f4-9f8f39fa268c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.696136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c97c85-1b78-4761-85f4-9f8f39fa268c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.722225 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-25c97c85-1b78-4761-85f4-9f8f39fa268c None None] MFA Rules not processed for user `5c08e5cbde29434bbf59d22731d3ced9`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:48.723473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-25c97c85-1b78-4761-85f4-9f8f39fa268c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:48.786661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 892/1769] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:48.791112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0365dd-4332-4249-a833-a540ee4b2284 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:48.850672 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0365dd-4332-4249-a833-a540ee4b2284 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:48.855255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4c7a2-7bcb-4579-8907-00f93845f627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:48.855901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4c7a2-7bcb-4579-8907-00f93845f627 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.856281 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4c7a2-7bcb-4579-8907-00f93845f627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.856553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c4c7a2-7bcb-4579-8907-00f93845f627 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.857239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4c7a2-7bcb-4579-8907-00f93845f627 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:48.859215 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c4c7a2-7bcb-4579-8907-00f93845f627 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:48.883757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 878/1770] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:48 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:48.887777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c97c85-1b78-4761-85f4-9f8f39fa268c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:48.898742 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c97c85-1b78-4761-85f4-9f8f39fa268c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:48.951859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2056ad9-5b84-453e-97a5-217af3f29fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:48.953209 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2056ad9-5b84-453e-97a5-217af3f29fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.953543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2056ad9-5b84-453e-97a5-217af3f29fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.953815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2056ad9-5b84-453e-97a5-217af3f29fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.954494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2056ad9-5b84-453e-97a5-217af3f29fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:48.956442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2056ad9-5b84-453e-97a5-217af3f29fd1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:48.974515 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 893/1771] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:48 2022] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:27:48.978478 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4c7a2-7bcb-4579-8907-00f93845f627 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:48.989196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c4c7a2-7bcb-4579-8907-00f93845f627 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:48.993798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272d671-2c4a-432f-b9a0-b069c9b68cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:48.994476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272d671-2c4a-432f-b9a0-b069c9b68cce admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:48.994757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272d671-2c4a-432f-b9a0-b069c9b68cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:48.995032 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272d671-2c4a-432f-b9a0-b069c9b68cce admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:48.995740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272d671-2c4a-432f-b9a0-b069c9b68cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:48.997369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272d671-2c4a-432f-b9a0-b069c9b68cce admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:49.009197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 879/1772] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:49.013338 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2056ad9-5b84-453e-97a5-217af3f29fd1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:49.027016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2056ad9-5b84-453e-97a5-217af3f29fd1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:49.031683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc15d5-a870-4c99-8d03-910c3be04195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:49.032589 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc15d5-a870-4c99-8d03-910c3be04195 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:49.032867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc15d5-a870-4c99-8d03-910c3be04195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:49.033140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc15d5-a870-4c99-8d03-910c3be04195 admin admin] PATH_INFO: `/v3/projects/5bfb9c05f2c442f998472060dc09a896/users/c5a885d6e36f4a18849370fb1f0256cc/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:49.047940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc15d5-a870-4c99-8d03-910c3be04195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfb9c05f2c442f998472060dc09a896, user_id=c5a885d6e36f4a18849370fb1f0256cc, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:49.050569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc15d5-a870-4c99-8d03-910c3be04195 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:49.068047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 894/1773] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:49 2022] PUT /identity/v3/projects/5bfb9c05f2c442f998472060dc09a896/users/c5a885d6e36f4a18849370fb1f0256cc/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:49.072254 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272d671-2c4a-432f-b9a0-b069c9b68cce admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:49.084057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272d671-2c4a-432f-b9a0-b069c9b68cce admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:49.175788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535d40c-b9ff-412a-88f6-2f96ca612add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:49.176702 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535d40c-b9ff-412a-88f6-2f96ca612add admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:49.176987 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535d40c-b9ff-412a-88f6-2f96ca612add admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:49.177262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535d40c-b9ff-412a-88f6-2f96ca612add admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:49.178042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535d40c-b9ff-412a-88f6-2f96ca612add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:49.179890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535d40c-b9ff-412a-88f6-2f96ca612add admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:49.194731 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 880/1774] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:49.196392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc15d5-a870-4c99-8d03-910c3be04195 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:49.236955 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc15d5-a870-4c99-8d03-910c3be04195 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:49.250663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffca52e-ad77-46f1-9a4a-141f3e428c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:49.252143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffca52e-ad77-46f1-9a4a-141f3e428c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:49.252432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffca52e-ad77-46f1-9a4a-141f3e428c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:49.252708 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffca52e-ad77-46f1-9a4a-141f3e428c11 admin admin] PATH_INFO: `/v3/projects/5bfb9c05f2c442f998472060dc09a896/users/c5a885d6e36f4a18849370fb1f0256cc/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:49.254751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffca52e-ad77-46f1-9a4a-141f3e428c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfb9c05f2c442f998472060dc09a896, user_id=c5a885d6e36f4a18849370fb1f0256cc, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:49.257458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffca52e-ad77-46f1-9a4a-141f3e428c11 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:49.282431 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 895/1775] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:49 2022] PUT /identity/v3/projects/5bfb9c05f2c442f998472060dc09a896/users/c5a885d6e36f4a18849370fb1f0256cc/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:49.284648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b52449-2f65-42f5-884e-ebdb71811ea6 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:49.284648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b52449-2f65-42f5-884e-ebdb71811ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:49.284911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b52449-2f65-42f5-884e-ebdb71811ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:49.317438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a6b52449-2f65-42f5-884e-ebdb71811ea6 None None] MFA Rules not processed for user `c5a885d6e36f4a18849370fb1f0256cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:49.319507 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a6b52449-2f65-42f5-884e-ebdb71811ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:49.407805 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 881/1776] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:49.415708 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffca52e-ad77-46f1-9a4a-141f3e428c11 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:49.417522 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2ffca52e-ad77-46f1-9a4a-141f3e428c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:49.526565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffca52e-ad77-46f1-9a4a-141f3e428c11 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:49.534312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ba8e-8fc9-461c-93e4-dcd30b2ccedb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:49.535453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ba8e-8fc9-461c-93e4-dcd30b2ccedb service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:49.536250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ba8e-8fc9-461c-93e4-dcd30b2ccedb service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:49.536763 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967ba8e-8fc9-461c-93e4-dcd30b2ccedb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:49.550217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967ba8e-8fc9-461c-93e4-dcd30b2ccedb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:49.553052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967ba8e-8fc9-461c-93e4-dcd30b2ccedb service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:49.565375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 896/1777] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:50.014317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b52449-2f65-42f5-884e-ebdb71811ea6 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:50.027131 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b52449-2f65-42f5-884e-ebdb71811ea6 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:50.037365 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf760eb3-c7d4-43a0-9738-d97c98730606 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5a885d6e36f4a18849370fb1f0256cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfb9c05f2c442f998472060dc09a896', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:50.038240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf760eb3-c7d4-43a0-9738-d97c98730606 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:50.038820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf760eb3-c7d4-43a0-9738-d97c98730606 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:50.039332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf760eb3-c7d4-43a0-9738-d97c98730606 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:50.040263 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf760eb3-c7d4-43a0-9738-d97c98730606 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:50.040577 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf760eb3-c7d4-43a0-9738-d97c98730606 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:50.042372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf760eb3-c7d4-43a0-9738-d97c98730606 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:50.061524 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 882/1778] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:50.063439 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ba8e-8fc9-461c-93e4-dcd30b2ccedb service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:50.072862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967ba8e-8fc9-461c-93e4-dcd30b2ccedb service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:50.078038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570aba6-911c-4334-8df6-61aa53d98269 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5a885d6e36f4a18849370fb1f0256cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfb9c05f2c442f998472060dc09a896', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:50.078695 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570aba6-911c-4334-8df6-61aa53d98269 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:50.079109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570aba6-911c-4334-8df6-61aa53d98269 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:50.079438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570aba6-911c-4334-8df6-61aa53d98269 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:50.080168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570aba6-911c-4334-8df6-61aa53d98269 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:50.082045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570aba6-911c-4334-8df6-61aa53d98269 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:50.120940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 897/1779] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:50 2022] POST /identity/v3/projects => generated 353 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:50.125553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf760eb3-c7d4-43a0-9738-d97c98730606 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:50.138185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf760eb3-c7d4-43a0-9738-d97c98730606 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:50.220500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b294b57-c20b-49c2-95fc-1a5d43d9be16 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5a885d6e36f4a18849370fb1f0256cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfb9c05f2c442f998472060dc09a896', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:50.221213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b294b57-c20b-49c2-95fc-1a5d43d9be16 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:50.221452 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b294b57-c20b-49c2-95fc-1a5d43d9be16 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:50.221726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b294b57-c20b-49c2-95fc-1a5d43d9be16 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:50.222483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b294b57-c20b-49c2-95fc-1a5d43d9be16 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:50.222754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b294b57-c20b-49c2-95fc-1a5d43d9be16 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:50.224560 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b294b57-c20b-49c2-95fc-1a5d43d9be16 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:50.241527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 883/1780] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:50.294943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570aba6-911c-4334-8df6-61aa53d98269 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:50.307801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570aba6-911c-4334-8df6-61aa53d98269 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:50.319563 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf128ca-2e37-41b2-9a49-159826148040 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5a885d6e36f4a18849370fb1f0256cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5bfb9c05f2c442f998472060dc09a896', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:50.320654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf128ca-2e37-41b2-9a49-159826148040 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:50.320944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf128ca-2e37-41b2-9a49-159826148040 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:50.321226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf128ca-2e37-41b2-9a49-159826148040 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] PATH_INFO: `/v3/projects/402fe4214c6d4727bb9b52cf1c4b0bfd` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:50.324450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf128ca-2e37-41b2-9a49-159826148040 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: Authorizing `identity:delete_project(project_id=402fe4214c6d4727bb9b52cf1c4b0bfd)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:50.326716 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf128ca-2e37-41b2-9a49-159826148040 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:50.378065 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bbf128ca-2e37-41b2-9a49-159826148040 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402fe4214c6d4727bb9b52cf1c4b0bfd', 'request_id': 'req-bbf128ca-2e37-41b2-9a49-159826148040'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:50.383684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bbf128ca-2e37-41b2-9a49-159826148040 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402fe4214c6d4727bb9b52cf1c4b0bfd', 'request_id': 'req-bbf128ca-2e37-41b2-9a49-159826148040'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:50.391526 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bbf128ca-2e37-41b2-9a49-159826148040 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402fe4214c6d4727bb9b52cf1c4b0bfd', 'request_id': 'req-bbf128ca-2e37-41b2-9a49-159826148040'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:50.405236 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bbf128ca-2e37-41b2-9a49-159826148040 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] The token cache is being invalidate because project 402fe4214c6d4727bb9b52cf1c4b0bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:50.405568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bbf128ca-2e37-41b2-9a49-159826148040 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:50.406541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bbf128ca-2e37-41b2-9a49-159826148040 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:50.408977 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 898/1781] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:50 2022] DELETE /identity/v3/projects/402fe4214c6d4727bb9b52cf1c4b0bfd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:50.652555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b294b57-c20b-49c2-95fc-1a5d43d9be16 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:50.654425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9b294b57-c20b-49c2-95fc-1a5d43d9be16 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:50.739420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b294b57-c20b-49c2-95fc-1a5d43d9be16 tempest-VolumeQuotaClassesTest-2007409315 tempest-VolumeQuotaClassesTest-2007409315-project-admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:50.796677 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:50.797543 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:50.797829 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:50.798100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] PATH_INFO: `/v3/users/5c08e5cbde29434bbf59d22731d3ced9` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:50.799393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c08e5cbde29434bbf59d22731d3ced9)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:50.801339 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:50.847072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c08e5cbde29434bbf59d22731d3ced9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:50.858346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c08e5cbde29434bbf59d22731d3ced9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:50.867350 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c08e5cbde29434bbf59d22731d3ced9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:50.874554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c08e5cbde29434bbf59d22731d3ced9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:50.875391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c08e5cbde29434bbf59d22731d3ced9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:50.881523 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 884/1782] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:50 2022] DELETE /identity/v3/users/5c08e5cbde29434bbf59d22731d3ced9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:50.885701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20d4ec-04ba-43ae-8725-3005644c0bd6 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:50.885985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20d4ec-04ba-43ae-8725-3005644c0bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:50.886255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20d4ec-04ba-43ae-8725-3005644c0bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:50.903545 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0b20d4ec-04ba-43ae-8725-3005644c0bd6 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:50.904765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0b20d4ec-04ba-43ae-8725-3005644c0bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:50.960377 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 899/1783] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:50.970678 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:50.972204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:51.045193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f1c64-a593-4391-b105-1a45728a0656 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:51.049204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333c0d6-3a09-46e6-bee8-ae3a138a9764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:51.049846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333c0d6-3a09-46e6-bee8-ae3a138a9764 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:51.050121 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333c0d6-3a09-46e6-bee8-ae3a138a9764 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:51.050391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333c0d6-3a09-46e6-bee8-ae3a138a9764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:51.059251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333c0d6-3a09-46e6-bee8-ae3a138a9764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:51.060697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333c0d6-3a09-46e6-bee8-ae3a138a9764 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:51.070370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 885/1784] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:27:51.458689 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20d4ec-04ba-43ae-8725-3005644c0bd6 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:51.460228 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0b20d4ec-04ba-43ae-8725-3005644c0bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:51.473864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20d4ec-04ba-43ae-8725-3005644c0bd6 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:51.479441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:51.480342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:51.480627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:51.480911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] PATH_INFO: `/v3/projects/7380430f8a6d481cb1a22bc124c50289` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:51.482199 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7380430f8a6d481cb1a22bc124c50289)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:51.485857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:51.534981 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7380430f8a6d481cb1a22bc124c50289', 'request_id': 'req-c93daaea-7963-4f17-b59f-5de474a471ec'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:51.540251 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7380430f8a6d481cb1a22bc124c50289', 'request_id': 'req-c93daaea-7963-4f17-b59f-5de474a471ec'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:51.547338 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7380430f8a6d481cb1a22bc124c50289', 'request_id': 'req-c93daaea-7963-4f17-b59f-5de474a471ec'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:51.559001 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] The token cache is being invalidate because project 7380430f8a6d481cb1a22bc124c50289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:51.559295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:51.559921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:51.561497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 900/1785] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:51 2022] DELETE /identity/v3/projects/7380430f8a6d481cb1a22bc124c50289 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:51.566453 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333c0d6-3a09-46e6-bee8-ae3a138a9764 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:51.575910 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333c0d6-3a09-46e6-bee8-ae3a138a9764 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:51.631956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d38c8-7fd5-4f16-acd3-cd100b069961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:51.632765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d38c8-7fd5-4f16-acd3-cd100b069961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:51.633041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d38c8-7fd5-4f16-acd3-cd100b069961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:51.633308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d38c8-7fd5-4f16-acd3-cd100b069961 admin admin] PATH_INFO: `/v3/users/c5a885d6e36f4a18849370fb1f0256cc` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:51.634468 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d38c8-7fd5-4f16-acd3-cd100b069961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a885d6e36f4a18849370fb1f0256cc)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:51.636412 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d38c8-7fd5-4f16-acd3-cd100b069961 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:51.679914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f42d38c8-7fd5-4f16-acd3-cd100b069961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a885d6e36f4a18849370fb1f0256cc'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:51.691795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f42d38c8-7fd5-4f16-acd3-cd100b069961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a885d6e36f4a18849370fb1f0256cc'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:51.698223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f42d38c8-7fd5-4f16-acd3-cd100b069961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a885d6e36f4a18849370fb1f0256cc'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:51.705246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f42d38c8-7fd5-4f16-acd3-cd100b069961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a885d6e36f4a18849370fb1f0256cc'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:51.705908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f42d38c8-7fd5-4f16-acd3-cd100b069961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a885d6e36f4a18849370fb1f0256cc'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:51.711536 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 886/1786] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:51 2022] DELETE /identity/v3/users/c5a885d6e36f4a18849370fb1f0256cc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:52.058827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:52.063637 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:52.086718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93daaea-7963-4f17-b59f-5de474a471ec admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:52.148512 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:52.149545 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:52.149842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:52.153262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] PATH_INFO: `/v3/projects/5bfb9c05f2c442f998472060dc09a896` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:52.153262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfb9c05f2c442f998472060dc09a896)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:52.153680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:52.211559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfb9c05f2c442f998472060dc09a896', 'request_id': 'req-5d6b1796-2ce4-473a-887a-ed57dea15a20'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:52.221382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfb9c05f2c442f998472060dc09a896', 'request_id': 'req-5d6b1796-2ce4-473a-887a-ed57dea15a20'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:52.231084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfb9c05f2c442f998472060dc09a896', 'request_id': 'req-5d6b1796-2ce4-473a-887a-ed57dea15a20'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:52.249785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] The token cache is being invalidate because project 5bfb9c05f2c442f998472060dc09a896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:52.250662 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:52.251352 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:52.253550 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 901/1787] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:52 2022] DELETE /identity/v3/projects/5bfb9c05f2c442f998472060dc09a896 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:52.258252 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d333690-56c2-4281-96a3-adffe12b6bf1 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:52.258766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d333690-56c2-4281-96a3-adffe12b6bf1 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:52.258875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d333690-56c2-4281-96a3-adffe12b6bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:52.279433 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-9d333690-56c2-4281-96a3-adffe12b6bf1 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:52.281987 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9d333690-56c2-4281-96a3-adffe12b6bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:52.301465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:52.303119 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:52.348812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 887/1788] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:52.356595 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522e147-177e-4a2d-81b0-8cbc3c13da86 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:52.357328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522e147-177e-4a2d-81b0-8cbc3c13da86 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:52.357652 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522e147-177e-4a2d-81b0-8cbc3c13da86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:52.391379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-1522e147-177e-4a2d-81b0-8cbc3c13da86 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:52.393051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1522e147-177e-4a2d-81b0-8cbc3c13da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:52.398458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b1796-2ce4-473a-887a-ed57dea15a20 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:52.408930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 888/1789] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:52.409945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522e147-177e-4a2d-81b0-8cbc3c13da86 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:52.413164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276abb5d-9b28-40bc-acd6-bed36c3398f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:52.414352 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276abb5d-9b28-40bc-acd6-bed36c3398f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:52.415057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276abb5d-9b28-40bc-acd6-bed36c3398f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:52.415540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276abb5d-9b28-40bc-acd6-bed36c3398f6 admin admin] PATH_INFO: `/v3/users/91216177e0f4401d9d632f8da0af4d2d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:52.424429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276abb5d-9b28-40bc-acd6-bed36c3398f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91216177e0f4401d9d632f8da0af4d2d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:52.426639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276abb5d-9b28-40bc-acd6-bed36c3398f6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:52.429573 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522e147-177e-4a2d-81b0-8cbc3c13da86 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:52.440479 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e0d0e-982e-4668-bc92-210c312f1d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:52.441524 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0d0e-982e-4668-bc92-210c312f1d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:52.442167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0d0e-982e-4668-bc92-210c312f1d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:52.442723 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0d0e-982e-4668-bc92-210c312f1d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:52.443638 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e0d0e-982e-4668-bc92-210c312f1d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:52.444173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e0d0e-982e-4668-bc92-210c312f1d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:52.446302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e0d0e-982e-4668-bc92-210c312f1d0c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:52.470726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 889/1790] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:52.472161 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e0d0e-982e-4668-bc92-210c312f1d0c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:52.489209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e0d0e-982e-4668-bc92-210c312f1d0c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:52.497438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41628264-76e6-4bf1-9b6e-66b02c9c1402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:52.498384 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41628264-76e6-4bf1-9b6e-66b02c9c1402 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:52.498675 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41628264-76e6-4bf1-9b6e-66b02c9c1402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:52.499000 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41628264-76e6-4bf1-9b6e-66b02c9c1402 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:52.500437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41628264-76e6-4bf1-9b6e-66b02c9c1402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:52.504228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41628264-76e6-4bf1-9b6e-66b02c9c1402 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:52.511190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-276abb5d-9b28-40bc-acd6-bed36c3398f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91216177e0f4401d9d632f8da0af4d2d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:52.528149 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-276abb5d-9b28-40bc-acd6-bed36c3398f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91216177e0f4401d9d632f8da0af4d2d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:52.531565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-276abb5d-9b28-40bc-acd6-bed36c3398f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91216177e0f4401d9d632f8da0af4d2d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:52.541746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-276abb5d-9b28-40bc-acd6-bed36c3398f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91216177e0f4401d9d632f8da0af4d2d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:52.550458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-276abb5d-9b28-40bc-acd6-bed36c3398f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91216177e0f4401d9d632f8da0af4d2d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:52.556898 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 890/1791] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:52 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:52.561556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41628264-76e6-4bf1-9b6e-66b02c9c1402 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:52.562140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 902/1792] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:52 2022] DELETE /identity/v3/users/91216177e0f4401d9d632f8da0af4d2d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:27:52.564326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-41628264-76e6-4bf1-9b6e-66b02c9c1402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:52.566604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f988c8-e387-4d0d-9d33-5b30a6c1b738 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:52.567035 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f988c8-e387-4d0d-9d33-5b30a6c1b738 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:52.567450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f988c8-e387-4d0d-9d33-5b30a6c1b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:52.591246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-23f988c8-e387-4d0d-9d33-5b30a6c1b738 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:52.592770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-23f988c8-e387-4d0d-9d33-5b30a6c1b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:52.661340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41628264-76e6-4bf1-9b6e-66b02c9c1402 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:52.670135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 903/1793] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:52.696122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f988c8-e387-4d0d-9d33-5b30a6c1b738 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:52.698614 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-23f988c8-e387-4d0d-9d33-5b30a6c1b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:52.756635 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5113fde-ff52-4e3d-b3e4-8f852629e42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:52.757741 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5113fde-ff52-4e3d-b3e4-8f852629e42a admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:52.758526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5113fde-ff52-4e3d-b3e4-8f852629e42a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:52.760000 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5113fde-ff52-4e3d-b3e4-8f852629e42a admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:52.762053 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5113fde-ff52-4e3d-b3e4-8f852629e42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:52.766467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5113fde-ff52-4e3d-b3e4-8f852629e42a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:52.824462 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f988c8-e387-4d0d-9d33-5b30a6c1b738 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:52.834438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09039a-3b71-48e4-8898-ebcdf417a41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:52.835248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09039a-3b71-48e4-8898-ebcdf417a41b service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:52.835533 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09039a-3b71-48e4-8898-ebcdf417a41b service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:52.835831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09039a-3b71-48e4-8898-ebcdf417a41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:52.836923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 891/1794] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:52 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:52.838084 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5113fde-ff52-4e3d-b3e4-8f852629e42a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:52.847175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09039a-3b71-48e4-8898-ebcdf417a41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:52.848798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09039a-3b71-48e4-8898-ebcdf417a41b service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:52.852120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5113fde-ff52-4e3d-b3e4-8f852629e42a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:52.860160 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a14dd-d6ba-488b-9224-467666fbe81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:52.861301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a14dd-d6ba-488b-9224-467666fbe81a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:52.861691 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 904/1795] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:52.861810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a14dd-d6ba-488b-9224-467666fbe81a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:52.862157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a14dd-d6ba-488b-9224-467666fbe81a admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:52.863093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a14dd-d6ba-488b-9224-467666fbe81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:52.865270 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a14dd-d6ba-488b-9224-467666fbe81a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:52.879064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 892/1796] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:52.883244 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09039a-3b71-48e4-8898-ebcdf417a41b service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:52.894343 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09039a-3b71-48e4-8898-ebcdf417a41b service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:52.899214 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ff0d0-1cf1-4edf-9fb6-cc87cee0b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:52.899885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ff0d0-1cf1-4edf-9fb6-cc87cee0b554 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:52.900200 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ff0d0-1cf1-4edf-9fb6-cc87cee0b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:52.900744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ff0d0-1cf1-4edf-9fb6-cc87cee0b554 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:52.901868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ff0d0-1cf1-4edf-9fb6-cc87cee0b554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:52.903520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ff0d0-1cf1-4edf-9fb6-cc87cee0b554 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:52.915881 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 905/1797] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:52.920016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a14dd-d6ba-488b-9224-467666fbe81a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:52.944619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a14dd-d6ba-488b-9224-467666fbe81a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:52.950661 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f715e-0530-4d5c-bae5-15053fda1f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:52.951562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f715e-0530-4d5c-bae5-15053fda1f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:52.951841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f715e-0530-4d5c-bae5-15053fda1f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:52.952224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f715e-0530-4d5c-bae5-15053fda1f9d admin admin] PATH_INFO: `/v3/projects/7f599a3bb62746ed8b81de0fe7bb64f0/users/aba7a2eaf9a64840bd8a291d9542cb19/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:52.970435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f715e-0530-4d5c-bae5-15053fda1f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f599a3bb62746ed8b81de0fe7bb64f0, user_id=aba7a2eaf9a64840bd8a291d9542cb19, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:52.973325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f715e-0530-4d5c-bae5-15053fda1f9d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:52.990171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 893/1798] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:52 2022] PUT /identity/v3/projects/7f599a3bb62746ed8b81de0fe7bb64f0/users/aba7a2eaf9a64840bd8a291d9542cb19/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:53.003587 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3768e-ee5d-4c30-9f3f-4bc4ff1d3681 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:53.004212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3768e-ee5d-4c30-9f3f-4bc4ff1d3681 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:53.004499 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3768e-ee5d-4c30-9f3f-4bc4ff1d3681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:53.047348 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9ce3768e-ee5d-4c30-9f3f-4bc4ff1d3681 None None] MFA Rules not processed for user `aba7a2eaf9a64840bd8a291d9542cb19`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:53.048698 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9ce3768e-ee5d-4c30-9f3f-4bc4ff1d3681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:53.119701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 906/1799] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:53.125373 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f715e-0530-4d5c-bae5-15053fda1f9d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:53.238921 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f715e-0530-4d5c-bae5-15053fda1f9d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:53.243914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca8c54-8703-4a21-a327-f4bfadc4fd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:53.244745 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca8c54-8703-4a21-a327-f4bfadc4fd30 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:53.245042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca8c54-8703-4a21-a327-f4bfadc4fd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:53.245382 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca8c54-8703-4a21-a327-f4bfadc4fd30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:53.246166 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca8c54-8703-4a21-a327-f4bfadc4fd30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:53.248383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca8c54-8703-4a21-a327-f4bfadc4fd30 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:53.284156 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 894/1800] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:53 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:53.286351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3768e-ee5d-4c30-9f3f-4bc4ff1d3681 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:53.298644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3768e-ee5d-4c30-9f3f-4bc4ff1d3681 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:53.366085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e553c-f90a-4817-a477-cc636075725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:53.366780 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e553c-f90a-4817-a477-cc636075725a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:53.367061 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e553c-f90a-4817-a477-cc636075725a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:53.367336 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e553c-f90a-4817-a477-cc636075725a admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:53.368161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e553c-f90a-4817-a477-cc636075725a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:53.371410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e553c-f90a-4817-a477-cc636075725a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:53.403397 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 907/1801] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:53 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:53.405455 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca8c54-8703-4a21-a327-f4bfadc4fd30 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:53.423031 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca8c54-8703-4a21-a327-f4bfadc4fd30 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:53.430497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd934f39-842e-4568-a345-015979fa3adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:53.431238 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd934f39-842e-4568-a345-015979fa3adf admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:53.431521 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd934f39-842e-4568-a345-015979fa3adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:53.431791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd934f39-842e-4568-a345-015979fa3adf admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:53.432704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd934f39-842e-4568-a345-015979fa3adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:53.435096 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd934f39-842e-4568-a345-015979fa3adf admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:53.452602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 895/1802] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:53.455077 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e553c-f90a-4817-a477-cc636075725a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:53.466360 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e553c-f90a-4817-a477-cc636075725a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:53.472445 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d5772-5496-4668-a72c-b7ec3e696979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:53.473505 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d5772-5496-4668-a72c-b7ec3e696979 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:53.473867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d5772-5496-4668-a72c-b7ec3e696979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:53.474360 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d5772-5496-4668-a72c-b7ec3e696979 admin admin] PATH_INFO: `/v3/projects/69f7f6fb3abc4fe78d5f7659c7d7149b/users/ac1a1a1c3a6647bdb706a985f245b07b/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:53.492440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d5772-5496-4668-a72c-b7ec3e696979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f7f6fb3abc4fe78d5f7659c7d7149b, user_id=ac1a1a1c3a6647bdb706a985f245b07b, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:53.495698 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d5772-5496-4668-a72c-b7ec3e696979 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:53.511988 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 908/1803] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:53 2022] PUT /identity/v3/projects/69f7f6fb3abc4fe78d5f7659c7d7149b/users/ac1a1a1c3a6647bdb706a985f245b07b/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:53.516658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd934f39-842e-4568-a345-015979fa3adf admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:53.528593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd934f39-842e-4568-a345-015979fa3adf admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:53.564895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d5772-5496-4668-a72c-b7ec3e696979 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:53.568109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6f3d5772-5496-4668-a72c-b7ec3e696979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:53.646739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d5772-5496-4668-a72c-b7ec3e696979 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:53.653596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742533fa-3d45-4170-b9ea-fa5a44104168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:53.654786 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742533fa-3d45-4170-b9ea-fa5a44104168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:53.655265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742533fa-3d45-4170-b9ea-fa5a44104168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:53.655857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742533fa-3d45-4170-b9ea-fa5a44104168 admin admin] PATH_INFO: `/v3/users/66b7273bafec493c86170c076bafe756` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:53.657331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742533fa-3d45-4170-b9ea-fa5a44104168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b7273bafec493c86170c076bafe756)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:53.659650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742533fa-3d45-4170-b9ea-fa5a44104168 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:53.684170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da48a8-c7f7-477f-b760-1fe13b521725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:53.685101 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da48a8-c7f7-477f-b760-1fe13b521725 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:53.687923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da48a8-c7f7-477f-b760-1fe13b521725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:53.688505 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da48a8-c7f7-477f-b760-1fe13b521725 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:53.690721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da48a8-c7f7-477f-b760-1fe13b521725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:53.695726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da48a8-c7f7-477f-b760-1fe13b521725 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:53.720091 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-742533fa-3d45-4170-b9ea-fa5a44104168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b7273bafec493c86170c076bafe756'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:53.720588 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 896/1804] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:53.724760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da48a8-c7f7-477f-b760-1fe13b521725 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:53.736517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da48a8-c7f7-477f-b760-1fe13b521725 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:53.737196 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-742533fa-3d45-4170-b9ea-fa5a44104168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b7273bafec493c86170c076bafe756'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:53.737948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-742533fa-3d45-4170-b9ea-fa5a44104168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b7273bafec493c86170c076bafe756'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:53.741752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946cce2-2779-430b-9278-2f7c83b1c7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:53.742656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946cce2-2779-430b-9278-2f7c83b1c7ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:53.743078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946cce2-2779-430b-9278-2f7c83b1c7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:53.743464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946cce2-2779-430b-9278-2f7c83b1c7ef admin admin] PATH_INFO: `/v3/projects/69f7f6fb3abc4fe78d5f7659c7d7149b/users/ac1a1a1c3a6647bdb706a985f245b07b/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:53.746376 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946cce2-2779-430b-9278-2f7c83b1c7ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f7f6fb3abc4fe78d5f7659c7d7149b, user_id=ac1a1a1c3a6647bdb706a985f245b07b, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:53.748699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-742533fa-3d45-4170-b9ea-fa5a44104168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b7273bafec493c86170c076bafe756'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:53.749218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946cce2-2779-430b-9278-2f7c83b1c7ef admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:53.759565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-742533fa-3d45-4170-b9ea-fa5a44104168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b7273bafec493c86170c076bafe756'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:53.768507 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 909/1805] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:53 2022] DELETE /identity/v3/users/66b7273bafec493c86170c076bafe756 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:27:53.772916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8497332-3dc8-4059-aadf-53058491e31c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:53.773521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8497332-3dc8-4059-aadf-53058491e31c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:53.774029 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8497332-3dc8-4059-aadf-53058491e31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:53.797598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 897/1806] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:53 2022] PUT /identity/v3/projects/69f7f6fb3abc4fe78d5f7659c7d7149b/users/ac1a1a1c3a6647bdb706a985f245b07b/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:27:53.799235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8ee2b-a474-47a2-a4a4-b0f55587be6f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:53.799531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8ee2b-a474-47a2-a4a4-b0f55587be6f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:53.799809 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8ee2b-a474-47a2-a4a4-b0f55587be6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:53.801776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b8497332-3dc8-4059-aadf-53058491e31c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:53.802978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b8497332-3dc8-4059-aadf-53058491e31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:53.834036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-43d8ee2b-a474-47a2-a4a4-b0f55587be6f None None] MFA Rules not processed for user `ac1a1a1c3a6647bdb706a985f245b07b`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:53.835349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-43d8ee2b-a474-47a2-a4a4-b0f55587be6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:53.865246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 910/1807] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:53.888272 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8497332-3dc8-4059-aadf-53058491e31c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:53.889688 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b8497332-3dc8-4059-aadf-53058491e31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:53.940072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 898/1808] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:53.948297 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8ee2b-a474-47a2-a4a4-b0f55587be6f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:53.950897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-43d8ee2b-a474-47a2-a4a4-b0f55587be6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:53.982912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8497332-3dc8-4059-aadf-53058491e31c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:53.989370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651742-fe2b-41f1-912e-f9b524fff852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:53.990131 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651742-fe2b-41f1-912e-f9b524fff852 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:53.990513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651742-fe2b-41f1-912e-f9b524fff852 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:53.990889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a651742-fe2b-41f1-912e-f9b524fff852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:54.006452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a651742-fe2b-41f1-912e-f9b524fff852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:54.008828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a651742-fe2b-41f1-912e-f9b524fff852 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:54.021013 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8ee2b-a474-47a2-a4a4-b0f55587be6f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:54.025206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 911/1809] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:27:54.025353 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6a368-ebe1-4ce7-9cf2-e6b08c682c30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:54.026404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6a368-ebe1-4ce7-9cf2-e6b08c682c30 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:54.027366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6a368-ebe1-4ce7-9cf2-e6b08c682c30 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:54.027366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6a368-ebe1-4ce7-9cf2-e6b08c682c30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:54.042098 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6a368-ebe1-4ce7-9cf2-e6b08c682c30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:54.046830 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6a368-ebe1-4ce7-9cf2-e6b08c682c30 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:54.062582 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 899/1810] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:27:54.418489 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651742-fe2b-41f1-912e-f9b524fff852 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:54.420349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9a651742-fe2b-41f1-912e-f9b524fff852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:54.462905 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a651742-fe2b-41f1-912e-f9b524fff852 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:54.475730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:54.479239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:54.480329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:54.480997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] PATH_INFO: `/v3/projects/606fd327fac94eae912ed8be0bc0611d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:54.483520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=606fd327fac94eae912ed8be0bc0611d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:54.487305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:54.614316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606fd327fac94eae912ed8be0bc0611d', 'request_id': 'req-e9a8ab9a-7137-43da-8ff0-779c1c759e86'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:54.622290 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606fd327fac94eae912ed8be0bc0611d', 'request_id': 'req-e9a8ab9a-7137-43da-8ff0-779c1c759e86'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:54.632566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606fd327fac94eae912ed8be0bc0611d', 'request_id': 'req-e9a8ab9a-7137-43da-8ff0-779c1c759e86'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:54.652885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] The token cache is being invalidate because project 606fd327fac94eae912ed8be0bc0611d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:54.654899 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:54.658706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:54.665822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 912/1811] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:54 2022] DELETE /identity/v3/projects/606fd327fac94eae912ed8be0bc0611d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:54.669750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6a368-ebe1-4ce7-9cf2-e6b08c682c30 service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:54.686500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6a368-ebe1-4ce7-9cf2-e6b08c682c30 service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:54.924437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:54.925783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:54.926302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:54.926757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] PATH_INFO: `/v3/users/dbf3aad171104246963c853ba43deb7d` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:54.928709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf3aad171104246963c853ba43deb7d)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:54.931053 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:55.039838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf3aad171104246963c853ba43deb7d'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.060775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf3aad171104246963c853ba43deb7d'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.076132 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf3aad171104246963c853ba43deb7d'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.114937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf3aad171104246963c853ba43deb7d'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.116128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf3aad171104246963c853ba43deb7d'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.128567 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 900/1812] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:54 2022] DELETE /identity/v3/users/dbf3aad171104246963c853ba43deb7d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:55.197097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:55.198560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:55.222155 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8ab9a-7137-43da-8ff0-779c1c759e86 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:55.295931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:55.298499 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:55.320081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f42122-658e-4ee9-abb9-17a55d4ddc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:55.321546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f42122-658e-4ee9-abb9-17a55d4ddc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:55.321845 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f42122-658e-4ee9-abb9-17a55d4ddc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:55.322174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f42122-658e-4ee9-abb9-17a55d4ddc15 admin admin] PATH_INFO: `/v3/users/aba7a2eaf9a64840bd8a291d9542cb19` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:55.324073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f42122-658e-4ee9-abb9-17a55d4ddc15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba7a2eaf9a64840bd8a291d9542cb19)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:55.339107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f42122-658e-4ee9-abb9-17a55d4ddc15 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:55.436293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed43e1-34a4-4fc4-88ef-ab304c481d67 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:55.436510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-47f42122-658e-4ee9-abb9-17a55d4ddc15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba7a2eaf9a64840bd8a291d9542cb19'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.443739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:55.445534 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:55.446014 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:55.447168 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] PATH_INFO: `/v3/projects/378d921e0ecd4ac787e28c9a159919af` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:55.448756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=378d921e0ecd4ac787e28c9a159919af)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:55.451133 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:55.456604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-47f42122-658e-4ee9-abb9-17a55d4ddc15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba7a2eaf9a64840bd8a291d9542cb19'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.458029 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-47f42122-658e-4ee9-abb9-17a55d4ddc15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba7a2eaf9a64840bd8a291d9542cb19'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.469178 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-47f42122-658e-4ee9-abb9-17a55d4ddc15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba7a2eaf9a64840bd8a291d9542cb19'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.480717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-47f42122-658e-4ee9-abb9-17a55d4ddc15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba7a2eaf9a64840bd8a291d9542cb19'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.491469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 913/1813] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:55 2022] DELETE /identity/v3/users/aba7a2eaf9a64840bd8a291d9542cb19 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:27:55.496729 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c762afa-7ce6-4f8e-a99e-68cc17306e00 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:55.497016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c762afa-7ce6-4f8e-a99e-68cc17306e00 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:55.497296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c762afa-7ce6-4f8e-a99e-68cc17306e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:55.520343 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0c762afa-7ce6-4f8e-a99e-68cc17306e00 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:55.522222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0c762afa-7ce6-4f8e-a99e-68cc17306e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:55.566803 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378d921e0ecd4ac787e28c9a159919af', 'request_id': 'req-538adf35-5f2b-4d71-8301-15707408d3c5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.587985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378d921e0ecd4ac787e28c9a159919af', 'request_id': 'req-538adf35-5f2b-4d71-8301-15707408d3c5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.605408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378d921e0ecd4ac787e28c9a159919af', 'request_id': 'req-538adf35-5f2b-4d71-8301-15707408d3c5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.632128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] The token cache is being invalidate because project 378d921e0ecd4ac787e28c9a159919af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:55.632816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.633872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.643244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 901/1814] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:55 2022] DELETE /identity/v3/projects/378d921e0ecd4ac787e28c9a159919af => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:27:55.645009 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:55.646863 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:55.653501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 914/1815] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:55.674827 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538adf35-5f2b-4d71-8301-15707408d3c5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:55.677854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c762afa-7ce6-4f8e-a99e-68cc17306e00 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:55.680227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0c762afa-7ce6-4f8e-a99e-68cc17306e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:55.681553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:55.682762 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:55.683121 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:55.683532 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] PATH_INFO: `/v3/users/7fa94d4d955d47a29c81eb9db0ff334f` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:55.684840 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fa94d4d955d47a29c81eb9db0ff334f)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:55.705197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:55.756864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c762afa-7ce6-4f8e-a99e-68cc17306e00 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:55.762380 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8df79f-43ea-47e9-8718-098815a7700f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:55.763796 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8df79f-43ea-47e9-8718-098815a7700f service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:55.764363 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8df79f-43ea-47e9-8718-098815a7700f service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:55.764898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8df79f-43ea-47e9-8718-098815a7700f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:55.777440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8df79f-43ea-47e9-8718-098815a7700f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:55.779069 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8df79f-43ea-47e9-8718-098815a7700f service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:55.783484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fa94d4d955d47a29c81eb9db0ff334f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.794385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 915/1816] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:27:55.799346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fa94d4d955d47a29c81eb9db0ff334f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.808394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fa94d4d955d47a29c81eb9db0ff334f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.816468 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fa94d4d955d47a29c81eb9db0ff334f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.817230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fa94d4d955d47a29c81eb9db0ff334f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:55.837941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 902/1817] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:55 2022] DELETE /identity/v3/users/7fa94d4d955d47a29c81eb9db0ff334f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:56.508993 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8df79f-43ea-47e9-8718-098815a7700f service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:56.510692 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8c8df79f-43ea-47e9-8718-098815a7700f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:56.527583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8df79f-43ea-47e9-8718-098815a7700f service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:56.662208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:56.666720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:56.667392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:56.667817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] PATH_INFO: `/v3/projects/46afae0d87304c37bf7ac42de4a68e0c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:56.669705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46afae0d87304c37bf7ac42de4a68e0c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:56.676825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:56.706255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:56.709683 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:56.739253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6535d-fe3e-4df1-9aaf-e8a252002054 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:56.749004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a04e11-60e3-4720-8564-0803cd4cf4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:56.759398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a04e11-60e3-4720-8564-0803cd4cf4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:56.759398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a04e11-60e3-4720-8564-0803cd4cf4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:56.759398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a04e11-60e3-4720-8564-0803cd4cf4a8 admin admin] PATH_INFO: `/v3/projects/1c74d657e9a84ec1b7d830019b23099b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:56.759398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a04e11-60e3-4720-8564-0803cd4cf4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c74d657e9a84ec1b7d830019b23099b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:56.759398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a04e11-60e3-4720-8564-0803cd4cf4a8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:56.801073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46afae0d87304c37bf7ac42de4a68e0c', 'request_id': 'req-17c990e7-e8fb-481f-b54f-571e6f548922'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:56.819712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46afae0d87304c37bf7ac42de4a68e0c', 'request_id': 'req-17c990e7-e8fb-481f-b54f-571e6f548922'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:56.833492 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46afae0d87304c37bf7ac42de4a68e0c', 'request_id': 'req-17c990e7-e8fb-481f-b54f-571e6f548922'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:56.836067 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-24a04e11-60e3-4720-8564-0803cd4cf4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c74d657e9a84ec1b7d830019b23099b', 'request_id': 'req-24a04e11-60e3-4720-8564-0803cd4cf4a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:56.844373 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-24a04e11-60e3-4720-8564-0803cd4cf4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c74d657e9a84ec1b7d830019b23099b', 'request_id': 'req-24a04e11-60e3-4720-8564-0803cd4cf4a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:56.857531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] The token cache is being invalidate because project 46afae0d87304c37bf7ac42de4a68e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:56.857893 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:56.859974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:56.862093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-24a04e11-60e3-4720-8564-0803cd4cf4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c74d657e9a84ec1b7d830019b23099b', 'request_id': 'req-24a04e11-60e3-4720-8564-0803cd4cf4a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:56.863017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 916/1818] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:56 2022] DELETE /identity/v3/projects/46afae0d87304c37bf7ac42de4a68e0c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:56.866286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:56.868747 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:56.891027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-24a04e11-60e3-4720-8564-0803cd4cf4a8 admin admin] The token cache is being invalidate because project 1c74d657e9a84ec1b7d830019b23099b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:56.891207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-24a04e11-60e3-4720-8564-0803cd4cf4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:56.893230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-24a04e11-60e3-4720-8564-0803cd4cf4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:56.895143 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 903/1819] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:56 2022] DELETE /identity/v3/projects/1c74d657e9a84ec1b7d830019b23099b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:56.903889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abeb4b-2373-4032-8757-55c1990508d4 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:56.904132 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abeb4b-2373-4032-8757-55c1990508d4 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:56.904410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abeb4b-2373-4032-8757-55c1990508d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:56.945569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-54abeb4b-2373-4032-8757-55c1990508d4 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:56.946776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-54abeb4b-2373-4032-8757-55c1990508d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:57.005015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c990e7-e8fb-481f-b54f-571e6f548922 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:57.082361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 904/1820] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:57.091918 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cef01-b742-489f-b45f-e63b2c33bd25 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.092337 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cef01-b742-489f-b45f-e63b2c33bd25 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.093780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cef01-b742-489f-b45f-e63b2c33bd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.116155 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6445a-7d2d-42f2-a79a-4328032d638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:57.117764 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6445a-7d2d-42f2-a79a-4328032d638e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.118334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6445a-7d2d-42f2-a79a-4328032d638e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.118814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6445a-7d2d-42f2-a79a-4328032d638e admin admin] PATH_INFO: `/v3/projects/7f599a3bb62746ed8b81de0fe7bb64f0` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.120845 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6445a-7d2d-42f2-a79a-4328032d638e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f599a3bb62746ed8b81de0fe7bb64f0)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:57.122960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6445a-7d2d-42f2-a79a-4328032d638e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:57.124112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-672cef01-b742-489f-b45f-e63b2c33bd25 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:57.125806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-672cef01-b742-489f-b45f-e63b2c33bd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:57.153303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 905/1821] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:57.154757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946bee-bd3e-42dd-ab3c-66d43b3b2bfb None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.155201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946bee-bd3e-42dd-ab3c-66d43b3b2bfb None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.155483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60946bee-bd3e-42dd-ab3c-66d43b3b2bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.179952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-60946bee-bd3e-42dd-ab3c-66d43b3b2bfb None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:57.181191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-60946bee-bd3e-42dd-ab3c-66d43b3b2bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:57.187254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-91b6445a-7d2d-42f2-a79a-4328032d638e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f599a3bb62746ed8b81de0fe7bb64f0', 'request_id': 'req-91b6445a-7d2d-42f2-a79a-4328032d638e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:57.194617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-91b6445a-7d2d-42f2-a79a-4328032d638e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f599a3bb62746ed8b81de0fe7bb64f0', 'request_id': 'req-91b6445a-7d2d-42f2-a79a-4328032d638e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:57.201994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-91b6445a-7d2d-42f2-a79a-4328032d638e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f599a3bb62746ed8b81de0fe7bb64f0', 'request_id': 'req-91b6445a-7d2d-42f2-a79a-4328032d638e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:57.218681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-91b6445a-7d2d-42f2-a79a-4328032d638e admin admin] The token cache is being invalidate because project 7f599a3bb62746ed8b81de0fe7bb64f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:57.219133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-91b6445a-7d2d-42f2-a79a-4328032d638e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:57.219844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-91b6445a-7d2d-42f2-a79a-4328032d638e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:57.221535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 917/1822] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:56 2022] DELETE /identity/v3/projects/7f599a3bb62746ed8b81de0fe7bb64f0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:57.222730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57f452-63b6-4506-a3b4-f01667a6396d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.223018 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57f452-63b6-4506-a3b4-f01667a6396d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.223312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57f452-63b6-4506-a3b4-f01667a6396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.243422 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6b57f452-63b6-4506-a3b4-f01667a6396d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:57.245038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6b57f452-63b6-4506-a3b4-f01667a6396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:57.252191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 906/1823] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:57.253872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60946bee-bd3e-42dd-ab3c-66d43b3b2bfb None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:57.255427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-60946bee-bd3e-42dd-ab3c-66d43b3b2bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:57.255620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 918/1824] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:57.256606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57f452-63b6-4506-a3b4-f01667a6396d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:57.267869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60946bee-bd3e-42dd-ab3c-66d43b3b2bfb None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:57.268603 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57f452-63b6-4506-a3b4-f01667a6396d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:57.272726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:57.273598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.273880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.274145 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] PATH_INFO: `/v3/users/ac1a1a1c3a6647bdb706a985f245b07b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.276255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1a1a1c3a6647bdb706a985f245b07b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:57.278187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1cb2-807d-4fe3-b401-9585fe9cc150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:57.278346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:57.279483 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1cb2-807d-4fe3-b401-9585fe9cc150 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.279911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1cb2-807d-4fe3-b401-9585fe9cc150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.280356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d1cb2-807d-4fe3-b401-9585fe9cc150 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.282187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1cb2-807d-4fe3-b401-9585fe9cc150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:57.282785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1cb2-807d-4fe3-b401-9585fe9cc150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:57.284442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d1cb2-807d-4fe3-b401-9585fe9cc150 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:57.296955 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 919/1825] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:57.297896 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1cb2-807d-4fe3-b401-9585fe9cc150 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:57.310611 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d1cb2-807d-4fe3-b401-9585fe9cc150 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:57.316425 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432b9fb-4e8b-4fb1-a3f0-771e0b304b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:57.317375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432b9fb-4e8b-4fb1-a3f0-771e0b304b72 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.317375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432b9fb-4e8b-4fb1-a3f0-771e0b304b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.317648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432b9fb-4e8b-4fb1-a3f0-771e0b304b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.318475 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432b9fb-4e8b-4fb1-a3f0-771e0b304b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:57.318652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432b9fb-4e8b-4fb1-a3f0-771e0b304b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:57.320312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432b9fb-4e8b-4fb1-a3f0-771e0b304b72 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:57.332614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1a1a1c3a6647bdb706a985f245b07b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:57.337886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 920/1826] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:57.337886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432b9fb-4e8b-4fb1-a3f0-771e0b304b72 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:57.345884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432b9fb-4e8b-4fb1-a3f0-771e0b304b72 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:57.351166 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb326ad-14dd-4c89-8cac-e6d21e9cf582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:57.351827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb326ad-14dd-4c89-8cac-e6d21e9cf582 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.352145 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb326ad-14dd-4c89-8cac-e6d21e9cf582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.352425 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb326ad-14dd-4c89-8cac-e6d21e9cf582 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.353164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb326ad-14dd-4c89-8cac-e6d21e9cf582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:57.353509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1a1a1c3a6647bdb706a985f245b07b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:57.355122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb326ad-14dd-4c89-8cac-e6d21e9cf582 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:57.363816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1a1a1c3a6647bdb706a985f245b07b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:57.376784 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1a1a1c3a6647bdb706a985f245b07b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:57.377609 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1a1a1c3a6647bdb706a985f245b07b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:57.385711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 907/1827] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:57 2022] DELETE /identity/v3/users/ac1a1a1c3a6647bdb706a985f245b07b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:57.389657 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:57.391529 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:57.395085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 921/1828] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:57 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:57.398839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb326ad-14dd-4c89-8cac-e6d21e9cf582 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:57.401231 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bbb326ad-14dd-4c89-8cac-e6d21e9cf582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:57.494731 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedab05-5578-4de3-bf97-0f7b98ea1b97 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:57.569772 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb326ad-14dd-4c89-8cac-e6d21e9cf582 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:57.575829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86372d1-e7fe-49de-8b06-cf2e06fe2dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:57.577141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86372d1-e7fe-49de-8b06-cf2e06fe2dff admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.578458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86372d1-e7fe-49de-8b06-cf2e06fe2dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.578840 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86372d1-e7fe-49de-8b06-cf2e06fe2dff admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.579648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86372d1-e7fe-49de-8b06-cf2e06fe2dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:57.582445 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86372d1-e7fe-49de-8b06-cf2e06fe2dff admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:57.615036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 922/1829] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:57 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:27:57.619579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86372d1-e7fe-49de-8b06-cf2e06fe2dff admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:57.620660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43e705-4185-4ce1-87e8-e8abc45931dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:57.621574 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43e705-4185-4ce1-87e8-e8abc45931dc admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.621869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43e705-4185-4ce1-87e8-e8abc45931dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.622242 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43e705-4185-4ce1-87e8-e8abc45931dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.623307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43e705-4185-4ce1-87e8-e8abc45931dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:57.627943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43e705-4185-4ce1-87e8-e8abc45931dc admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:57.635100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86372d1-e7fe-49de-8b06-cf2e06fe2dff admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:57.642814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc3186-b44a-4244-a9f8-819b0c69657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:57.643237 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc3186-b44a-4244-a9f8-819b0c69657c admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.643568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc3186-b44a-4244-a9f8-819b0c69657c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.643847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc3186-b44a-4244-a9f8-819b0c69657c admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.645368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc3186-b44a-4244-a9f8-819b0c69657c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:57.647331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc3186-b44a-4244-a9f8-819b0c69657c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:57.663262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 923/1830] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:57.666414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc3186-b44a-4244-a9f8-819b0c69657c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:57.682964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc3186-b44a-4244-a9f8-819b0c69657c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:57.683452 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 908/1831] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:57 2022] POST /identity/v3/projects => generated 387 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:57.688877 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43e705-4185-4ce1-87e8-e8abc45931dc admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:57.789558 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0bf7-361b-48e3-a3f4-2a391b64b054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:57.790693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0bf7-361b-48e3-a3f4-2a391b64b054 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.791178 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0bf7-361b-48e3-a3f4-2a391b64b054 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.791683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83be0bf7-361b-48e3-a3f4-2a391b64b054 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.792950 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be0bf7-361b-48e3-a3f4-2a391b64b054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:57.795487 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83be0bf7-361b-48e3-a3f4-2a391b64b054 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:57.811512 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 924/1832] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:57.817129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0bf7-361b-48e3-a3f4-2a391b64b054 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:57.832665 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83be0bf7-361b-48e3-a3f4-2a391b64b054 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:57.839628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc635ae-8eea-44b1-a8b5-65915ce4a7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:57.840689 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc635ae-8eea-44b1-a8b5-65915ce4a7af admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.841149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43e705-4185-4ce1-87e8-e8abc45931dc admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:57.841627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc635ae-8eea-44b1-a8b5-65915ce4a7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.841627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc635ae-8eea-44b1-a8b5-65915ce4a7af admin admin] PATH_INFO: `/v3/projects/13b13ed801b74f4fb9367ef45776d947/users/ec532218ae994c4c8bf086325a3d5b6d/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.848572 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daecc1-b27a-4cd6-9aba-565800eb6d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:57.849483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daecc1-b27a-4cd6-9aba-565800eb6d8d admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:57.849866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daecc1-b27a-4cd6-9aba-565800eb6d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:57.850237 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daecc1-b27a-4cd6-9aba-565800eb6d8d admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:57.851023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daecc1-b27a-4cd6-9aba-565800eb6d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:57.853227 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daecc1-b27a-4cd6-9aba-565800eb6d8d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:57.862685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc635ae-8eea-44b1-a8b5-65915ce4a7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b13ed801b74f4fb9367ef45776d947, user_id=ec532218ae994c4c8bf086325a3d5b6d, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:57.865728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc635ae-8eea-44b1-a8b5-65915ce4a7af admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:57.882343 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 909/1833] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:57 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:57.883223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daecc1-b27a-4cd6-9aba-565800eb6d8d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:57.886875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c3daecc1-b27a-4cd6-9aba-565800eb6d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:57.890801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 925/1834] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:57 2022] PUT /identity/v3/projects/13b13ed801b74f4fb9367ef45776d947/users/ec532218ae994c4c8bf086325a3d5b6d/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:57.892801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc635ae-8eea-44b1-a8b5-65915ce4a7af admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:57.928541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daecc1-b27a-4cd6-9aba-565800eb6d8d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:57.989066 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc635ae-8eea-44b1-a8b5-65915ce4a7af admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.001568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb203cd-f43e-4708-8dbc-3bc00d149b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.002673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb203cd-f43e-4708-8dbc-3bc00d149b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.002673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb203cd-f43e-4708-8dbc-3bc00d149b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.002877 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb203cd-f43e-4708-8dbc-3bc00d149b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.003485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb203cd-f43e-4708-8dbc-3bc00d149b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.010046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb203cd-f43e-4708-8dbc-3bc00d149b9d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.024731 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.025879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.026160 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.026434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] PATH_INFO: `/v3/projects/69f7f6fb3abc4fe78d5f7659c7d7149b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.037736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 926/1835] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:58.037943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f7f6fb3abc4fe78d5f7659c7d7149b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.038023 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a2764-58d8-4a22-92d6-c3baa48c5bbd None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.038091 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.038156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a2764-58d8-4a22-92d6-c3baa48c5bbd None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.038220 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a2764-58d8-4a22-92d6-c3baa48c5bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.083263 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1b6a2764-58d8-4a22-92d6-c3baa48c5bbd None None] MFA Rules not processed for user `ec532218ae994c4c8bf086325a3d5b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:58.084760 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1b6a2764-58d8-4a22-92d6-c3baa48c5bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:58.121880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f7f6fb3abc4fe78d5f7659c7d7149b', 'request_id': 'req-753224f7-b53f-4c47-abaf-74923423adec'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:58.130622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f7f6fb3abc4fe78d5f7659c7d7149b', 'request_id': 'req-753224f7-b53f-4c47-abaf-74923423adec'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:58.138705 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f7f6fb3abc4fe78d5f7659c7d7149b', 'request_id': 'req-753224f7-b53f-4c47-abaf-74923423adec'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:58.172173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] The token cache is being invalidate because project 69f7f6fb3abc4fe78d5f7659c7d7149b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:27:58.172531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:58.173144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:58.175009 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 910/1836] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:27:57 2022] DELETE /identity/v3/projects/69f7f6fb3abc4fe78d5f7659c7d7149b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:58.175852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.177236 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 927/1837] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:58.179544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018bf7d-1d35-4a6c-a597-473707fe38a4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.180071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018bf7d-1d35-4a6c-a597-473707fe38a4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.180749 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018bf7d-1d35-4a6c-a597-473707fe38a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.182004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:58.200681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9018bf7d-1d35-4a6c-a597-473707fe38a4 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:58.202358 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9018bf7d-1d35-4a6c-a597-473707fe38a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:58.253555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753224f7-b53f-4c47-abaf-74923423adec admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.259599 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73b9db-1c3c-4125-92ce-9b5e8daae7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.260298 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73b9db-1c3c-4125-92ce-9b5e8daae7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.260577 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73b9db-1c3c-4125-92ce-9b5e8daae7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.260848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73b9db-1c3c-4125-92ce-9b5e8daae7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.261565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73b9db-1c3c-4125-92ce-9b5e8daae7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.265963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 928/1838] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:27:58.268660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73b9db-1c3c-4125-92ce-9b5e8daae7a7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.269155 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018bf7d-1d35-4a6c-a597-473707fe38a4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.270898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9018bf7d-1d35-4a6c-a597-473707fe38a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:58.280984 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 911/1839] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:58.282574 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a07117-65c9-4ee6-854a-3c88d3557096 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.282865 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a07117-65c9-4ee6-854a-3c88d3557096 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.283140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a07117-65c9-4ee6-854a-3c88d3557096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.289750 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018bf7d-1d35-4a6c-a597-473707fe38a4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.294822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09219fc-1f51-4aba-8bbe-50006e1cb32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.295586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09219fc-1f51-4aba-8bbe-50006e1cb32d admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.295946 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09219fc-1f51-4aba-8bbe-50006e1cb32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.296845 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09219fc-1f51-4aba-8bbe-50006e1cb32d admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.298132 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09219fc-1f51-4aba-8bbe-50006e1cb32d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.300005 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09219fc-1f51-4aba-8bbe-50006e1cb32d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.303294 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-25a07117-65c9-4ee6-854a-3c88d3557096 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:58.304583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-25a07117-65c9-4ee6-854a-3c88d3557096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:58.316089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 912/1840] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:58.316089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a07117-65c9-4ee6-854a-3c88d3557096 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.324698 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a07117-65c9-4ee6-854a-3c88d3557096 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.330306 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e245f-6342-4636-a495-23f78e45cf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.330865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 929/1841] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:58 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:58.331761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09219fc-1f51-4aba-8bbe-50006e1cb32d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.334217 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e245f-6342-4636-a495-23f78e45cf23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.334664 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e245f-6342-4636-a495-23f78e45cf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.335072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e245f-6342-4636-a495-23f78e45cf23 admin admin] PATH_INFO: `/v3/projects/b586f2a880b94ee7a7781a9a48ba4c87/users/585200a8b17547eaa73316848e02d73a/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.355701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e245f-6342-4636-a495-23f78e45cf23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b586f2a880b94ee7a7781a9a48ba4c87, user_id=585200a8b17547eaa73316848e02d73a, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.358396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e245f-6342-4636-a495-23f78e45cf23 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.378732 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 913/1842] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:58 2022] PUT /identity/v3/projects/b586f2a880b94ee7a7781a9a48ba4c87/users/585200a8b17547eaa73316848e02d73a/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:58.379817 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e245f-6342-4636-a495-23f78e45cf23 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.415620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09219fc-1f51-4aba-8bbe-50006e1cb32d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.457869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e245f-6342-4636-a495-23f78e45cf23 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.462894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107dad5-c948-43a3-97d7-1a687af741ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.463559 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107dad5-c948-43a3-97d7-1a687af741ab admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.463838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107dad5-c948-43a3-97d7-1a687af741ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.464138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107dad5-c948-43a3-97d7-1a687af741ab admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.464865 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107dad5-c948-43a3-97d7-1a687af741ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.466941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107dad5-c948-43a3-97d7-1a687af741ab admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.475364 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde734a-af25-4ed1-947f-9def6d2e208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.476039 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde734a-af25-4ed1-947f-9def6d2e208e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.476335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde734a-af25-4ed1-947f-9def6d2e208e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.476612 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde734a-af25-4ed1-947f-9def6d2e208e admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.477332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde734a-af25-4ed1-947f-9def6d2e208e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:27:58.477641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde734a-af25-4ed1-947f-9def6d2e208e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.479215 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde734a-af25-4ed1-947f-9def6d2e208e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.487904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 914/1843] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:58 2022] POST /identity/v3/users => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:58.489551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63051-f15f-43c6-b11c-59b2a8b6ee7e None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.489844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63051-f15f-43c6-b11c-59b2a8b6ee7e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.490127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63051-f15f-43c6-b11c-59b2a8b6ee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.491074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 930/1844] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:27:58.491971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde734a-af25-4ed1-947f-9def6d2e208e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.501753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde734a-af25-4ed1-947f-9def6d2e208e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.506525 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a7f25-8f09-40a6-96db-2019fce7f5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.507162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a7f25-8f09-40a6-96db-2019fce7f5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.507447 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a7f25-8f09-40a6-96db-2019fce7f5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.507723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a7f25-8f09-40a6-96db-2019fce7f5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.508458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a7f25-8f09-40a6-96db-2019fce7f5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.510033 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a7f25-8f09-40a6-96db-2019fce7f5b2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.520235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-04a63051-f15f-43c6-b11c-59b2a8b6ee7e None None] MFA Rules not processed for user `585200a8b17547eaa73316848e02d73a`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:58.520574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 931/1845] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:27:58.521353 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a7f25-8f09-40a6-96db-2019fce7f5b2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.521469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-04a63051-f15f-43c6-b11c-59b2a8b6ee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:58.533475 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a7f25-8f09-40a6-96db-2019fce7f5b2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.538071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6f1bf-74da-4da6-b7c7-30afaa1281fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.538707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6f1bf-74da-4da6-b7c7-30afaa1281fa admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.538981 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6f1bf-74da-4da6-b7c7-30afaa1281fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.539250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6f1bf-74da-4da6-b7c7-30afaa1281fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.539921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6f1bf-74da-4da6-b7c7-30afaa1281fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.541817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6f1bf-74da-4da6-b7c7-30afaa1281fa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.572608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 932/1846] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:58 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:58.572608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6f1bf-74da-4da6-b7c7-30afaa1281fa admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.590312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 915/1847] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:58.591213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a63051-f15f-43c6-b11c-59b2a8b6ee7e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.602386 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a63051-f15f-43c6-b11c-59b2a8b6ee7e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.634223 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6f1bf-74da-4da6-b7c7-30afaa1281fa admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.639864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c7bba-f7aa-4fde-86b9-ff763c47f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.640853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c7bba-f7aa-4fde-86b9-ff763c47f0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.641144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c7bba-f7aa-4fde-86b9-ff763c47f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.641422 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c7bba-f7aa-4fde-86b9-ff763c47f0bd admin admin] PATH_INFO: `/v3/projects/7488e757dcd34ec7b2cae92ae18a01f4/users/b429be5be9d44a6185fa45daf1f9c1cc/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.660536 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c7bba-f7aa-4fde-86b9-ff763c47f0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7488e757dcd34ec7b2cae92ae18a01f4, user_id=b429be5be9d44a6185fa45daf1f9c1cc, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.663204 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c7bba-f7aa-4fde-86b9-ff763c47f0bd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.668566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7c5d7-27b0-4f7d-bf2b-b49aad67fcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.669323 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7c5d7-27b0-4f7d-bf2b-b49aad67fcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.669729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7c5d7-27b0-4f7d-bf2b-b49aad67fcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.670396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7c5d7-27b0-4f7d-bf2b-b49aad67fcb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.670805 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7c5d7-27b0-4f7d-bf2b-b49aad67fcb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.673533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7c5d7-27b0-4f7d-bf2b-b49aad67fcb1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.681536 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 933/1848] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:58 2022] PUT /identity/v3/projects/7488e757dcd34ec7b2cae92ae18a01f4/users/b429be5be9d44a6185fa45daf1f9c1cc/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:58.682234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c7bba-f7aa-4fde-86b9-ff763c47f0bd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.698669 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 916/1849] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:58 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:58.698669 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7c5d7-27b0-4f7d-bf2b-b49aad67fcb1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.707613 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7c5d7-27b0-4f7d-bf2b-b49aad67fcb1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.752958 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c7bba-f7aa-4fde-86b9-ff763c47f0bd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.757843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0077308-67e1-40f7-9ff0-9a5d9f5226c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.758524 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0077308-67e1-40f7-9ff0-9a5d9f5226c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.758808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0077308-67e1-40f7-9ff0-9a5d9f5226c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.759086 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0077308-67e1-40f7-9ff0-9a5d9f5226c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.759785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0077308-67e1-40f7-9ff0-9a5d9f5226c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.761948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0077308-67e1-40f7-9ff0-9a5d9f5226c0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.769625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92962-2c63-4a6e-b14a-6dc593e6bda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.770403 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92962-2c63-4a6e-b14a-6dc593e6bda3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.770757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92962-2c63-4a6e-b14a-6dc593e6bda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.771100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c92962-2c63-4a6e-b14a-6dc593e6bda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.771898 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c92962-2c63-4a6e-b14a-6dc593e6bda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.773565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c92962-2c63-4a6e-b14a-6dc593e6bda3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.789198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 917/1850] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:58.789198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92962-2c63-4a6e-b14a-6dc593e6bda3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.798208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 934/1851] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:58 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:58.798208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0077308-67e1-40f7-9ff0-9a5d9f5226c0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.801309 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c92962-2c63-4a6e-b14a-6dc593e6bda3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.863167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517c773-c752-4947-83fe-2583b7a315f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.864702 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517c773-c752-4947-83fe-2583b7a315f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.864989 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517c773-c752-4947-83fe-2583b7a315f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.865400 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517c773-c752-4947-83fe-2583b7a315f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.866156 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517c773-c752-4947-83fe-2583b7a315f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.866259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0077308-67e1-40f7-9ff0-9a5d9f5226c0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.867906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517c773-c752-4947-83fe-2583b7a315f6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.871716 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a64ad-586c-4c48-acae-3553085a02ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.872763 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a64ad-586c-4c48-acae-3553085a02ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.872918 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a64ad-586c-4c48-acae-3553085a02ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.873782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a64ad-586c-4c48-acae-3553085a02ae admin admin] PATH_INFO: `/v3/projects/7488e757dcd34ec7b2cae92ae18a01f4/users/b429be5be9d44a6185fa45daf1f9c1cc/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.876716 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a64ad-586c-4c48-acae-3553085a02ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7488e757dcd34ec7b2cae92ae18a01f4, user_id=b429be5be9d44a6185fa45daf1f9c1cc, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.881464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 918/1852] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:58.881602 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a64ad-586c-4c48-acae-3553085a02ae admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.881678 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517c773-c752-4947-83fe-2583b7a315f6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.896485 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517c773-c752-4947-83fe-2583b7a315f6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.900113 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 935/1853] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:58 2022] PUT /identity/v3/projects/7488e757dcd34ec7b2cae92ae18a01f4/users/b429be5be9d44a6185fa45daf1f9c1cc/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:58.902839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a64ad-586c-4c48-acae-3553085a02ae admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:58.960876 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5da92-09bc-4da7-b212-6a363e48f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.961674 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5da92-09bc-4da7-b212-6a363e48f9ba admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.962015 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5da92-09bc-4da7-b212-6a363e48f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.962359 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5da92-09bc-4da7-b212-6a363e48f9ba admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.963061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5da92-09bc-4da7-b212-6a363e48f9ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.965085 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a5da92-09bc-4da7-b212-6a363e48f9ba admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.972428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a64ad-586c-4c48-acae-3553085a02ae admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:58.978664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f339f6-18ee-4d5f-9cad-424b539aedd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:58.979480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f339f6-18ee-4d5f-9cad-424b539aedd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.979810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f339f6-18ee-4d5f-9cad-424b539aedd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.980206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f339f6-18ee-4d5f-9cad-424b539aedd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:58.980997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f339f6-18ee-4d5f-9cad-424b539aedd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:58.982672 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f339f6-18ee-4d5f-9cad-424b539aedd3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:58.990591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 919/1854] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:58 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:58.990591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2697aa-a940-44ac-8a23-e770c3976f01 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:58.990591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2697aa-a940-44ac-8a23-e770c3976f01 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:58.991303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2697aa-a940-44ac-8a23-e770c3976f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.000196 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 936/1855] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:59.000196 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f339f6-18ee-4d5f-9cad-424b539aedd3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:59.019747 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f339f6-18ee-4d5f-9cad-424b539aedd3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:59.023887 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-ae2697aa-a940-44ac-8a23-e770c3976f01 None None] MFA Rules not processed for user `b429be5be9d44a6185fa45daf1f9c1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:59.025198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ae2697aa-a940-44ac-8a23-e770c3976f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:59.025968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d40875-1cb8-4555-a762-2a05e2abb978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:59.026844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d40875-1cb8-4555-a762-2a05e2abb978 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.027048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d40875-1cb8-4555-a762-2a05e2abb978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.027834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d40875-1cb8-4555-a762-2a05e2abb978 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.029037 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d40875-1cb8-4555-a762-2a05e2abb978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:59.030311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d40875-1cb8-4555-a762-2a05e2abb978 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:59.049707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 937/1856] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:59.053555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d40875-1cb8-4555-a762-2a05e2abb978 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:59.065288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d40875-1cb8-4555-a762-2a05e2abb978 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:59.070036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6d8cd-0aa4-434d-941e-6f3000164ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:59.071035 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6d8cd-0aa4-434d-941e-6f3000164ded admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.071383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6d8cd-0aa4-434d-941e-6f3000164ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.071720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6d8cd-0aa4-434d-941e-6f3000164ded admin admin] PATH_INFO: `/v3/projects/6e17c61d3244485394d215766e3bee74/users/80447dcb5d224e4fb084d41c39d1049e/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.088922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6d8cd-0aa4-434d-941e-6f3000164ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e17c61d3244485394d215766e3bee74, user_id=80447dcb5d224e4fb084d41c39d1049e, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:59.091848 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6d8cd-0aa4-434d-941e-6f3000164ded admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:59.110305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 938/1857] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:59 2022] PUT /identity/v3/projects/6e17c61d3244485394d215766e3bee74/users/80447dcb5d224e4fb084d41c39d1049e/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:59.119411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 920/1858] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:59.119812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2697aa-a940-44ac-8a23-e770c3976f01 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:59.133697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291955ad-a758-4d63-b4a1-f7eec3c017c3 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.133968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291955ad-a758-4d63-b4a1-f7eec3c017c3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.134249 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291955ad-a758-4d63-b4a1-f7eec3c017c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.137348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2697aa-a940-44ac-8a23-e770c3976f01 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:59.195043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-291955ad-a758-4d63-b4a1-f7eec3c017c3 None None] MFA Rules not processed for user `80447dcb5d224e4fb084d41c39d1049e`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:59.200481 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-291955ad-a758-4d63-b4a1-f7eec3c017c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:59.222299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cf56e-f2e7-477a-8866-cdab4581d34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:59.223299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cf56e-f2e7-477a-8866-cdab4581d34a admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.223586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cf56e-f2e7-477a-8866-cdab4581d34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.223931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554cf56e-f2e7-477a-8866-cdab4581d34a admin admin] PATH_INFO: `/v3/projects/4b1e604bb8914cff8210fa80ad0c66d4/users/c28c36dcf30d4d90948d31b6df57981c/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.261393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cf56e-f2e7-477a-8866-cdab4581d34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1e604bb8914cff8210fa80ad0c66d4, user_id=c28c36dcf30d4d90948d31b6df57981c, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:59.264488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554cf56e-f2e7-477a-8866-cdab4581d34a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:59.286936 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 921/1859] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:59 2022] PUT /identity/v3/projects/4b1e604bb8914cff8210fa80ad0c66d4/users/c28c36dcf30d4d90948d31b6df57981c/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:59.287819 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cf56e-f2e7-477a-8866-cdab4581d34a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:59.290678 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-554cf56e-f2e7-477a-8866-cdab4581d34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:59.384391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 939/1860] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:59.386339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da330b-e9b4-4407-87f9-aa79fc9cf282 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.386633 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da330b-e9b4-4407-87f9-aa79fc9cf282 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.386910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da330b-e9b4-4407-87f9-aa79fc9cf282 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.389786 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 940/1861] 10.222.0.90 () {54 vars in 921 bytes} [Wed Feb 16 09:27:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:27:59.391397 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da330b-e9b4-4407-87f9-aa79fc9cf282 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:59.446431 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554cf56e-f2e7-477a-8866-cdab4581d34a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:59.476206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e66f1e-4cf7-4aff-bf46-413e0ffe8ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:59.477203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e66f1e-4cf7-4aff-bf46-413e0ffe8ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.477559 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e66f1e-4cf7-4aff-bf46-413e0ffe8ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.487423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e66f1e-4cf7-4aff-bf46-413e0ffe8ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.566410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da330b-e9b4-4407-87f9-aa79fc9cf282 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:59.579904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff8625-e988-4a4c-a99f-ef74fb0d919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:59.581181 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff8625-e988-4a4c-a99f-ef74fb0d919a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.581822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff8625-e988-4a4c-a99f-ef74fb0d919a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.581822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff8625-e988-4a4c-a99f-ef74fb0d919a admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.582473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff8625-e988-4a4c-a99f-ef74fb0d919a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:59.587110 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff8625-e988-4a4c-a99f-ef74fb0d919a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:59.602617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e66f1e-4cf7-4aff-bf46-413e0ffe8ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:59.604066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e66f1e-4cf7-4aff-bf46-413e0ffe8ff9 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:59.617132 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 941/1862] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:27:59.619296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff8625-e988-4a4c-a99f-ef74fb0d919a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:59.621724 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 922/1863] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:27:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:27:59.632673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff8625-e988-4a4c-a99f-ef74fb0d919a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:59.635315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b1622-dfd6-4e47-949e-17f1a7aa8be0 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.635798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b1622-dfd6-4e47-949e-17f1a7aa8be0 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.636272 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b1622-dfd6-4e47-949e-17f1a7aa8be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.646968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285703b-ef5d-4e90-ae64-161a25f64832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:59.646968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285703b-ef5d-4e90-ae64-161a25f64832 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.646968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285703b-ef5d-4e90-ae64-161a25f64832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.646968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285703b-ef5d-4e90-ae64-161a25f64832 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.647442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285703b-ef5d-4e90-ae64-161a25f64832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:59.647442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285703b-ef5d-4e90-ae64-161a25f64832 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:59.684751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 942/1864] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:27:59 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:59.686857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285703b-ef5d-4e90-ae64-161a25f64832 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:59.695260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a24b1622-dfd6-4e47-949e-17f1a7aa8be0 None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:27:59.696848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a24b1622-dfd6-4e47-949e-17f1a7aa8be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:27:59.800102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 923/1865] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Feb 16 09:27:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:27:59.801017 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b1622-dfd6-4e47-949e-17f1a7aa8be0 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:59.833849 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285703b-ef5d-4e90-ae64-161a25f64832 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:59.840935 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40369d2f-7a54-4c90-9928-0bf857cd8cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:59.842137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40369d2f-7a54-4c90-9928-0bf857cd8cad admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.842484 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40369d2f-7a54-4c90-9928-0bf857cd8cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.842823 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40369d2f-7a54-4c90-9928-0bf857cd8cad admin admin] PATH_INFO: `/v3/projects/4b1e604bb8914cff8210fa80ad0c66d4/users/c28c36dcf30d4d90948d31b6df57981c/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.845884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40369d2f-7a54-4c90-9928-0bf857cd8cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1e604bb8914cff8210fa80ad0c66d4, user_id=c28c36dcf30d4d90948d31b6df57981c, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:59.848717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40369d2f-7a54-4c90-9928-0bf857cd8cad admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:59.861237 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 943/1866] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:27:59 2022] PUT /identity/v3/projects/4b1e604bb8914cff8210fa80ad0c66d4/users/c28c36dcf30d4d90948d31b6df57981c/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:27:59.864075 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40369d2f-7a54-4c90-9928-0bf857cd8cad admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:27:59.871605 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b1622-dfd6-4e47-949e-17f1a7aa8be0 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:59.933249 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40369d2f-7a54-4c90-9928-0bf857cd8cad admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:27:59.934808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac2c6-20a6-463f-a305-e6ae8cca8ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:59.935559 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac2c6-20a6-463f-a305-e6ae8cca8ced admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.935916 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac2c6-20a6-463f-a305-e6ae8cca8ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.936824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac2c6-20a6-463f-a305-e6ae8cca8ced admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.937076 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac2c6-20a6-463f-a305-e6ae8cca8ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:59.939136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:27:59.939322 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac2c6-20a6-463f-a305-e6ae8cca8ced admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:59.940179 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.940835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.940835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] PATH_INFO: `/v3/users/ec532218ae994c4c8bf086325a3d5b6d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.942140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec532218ae994c4c8bf086325a3d5b6d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:27:59.944281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:27:59.967937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 924/1867] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:27:59 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:27:59.967937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6b185-e0a8-43a9-aae3-84c83074641d None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:27:59.967937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6b185-e0a8-43a9-aae3-84c83074641d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:27:59.967937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6b185-e0a8-43a9-aae3-84c83074641d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:27:59.994101 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec532218ae994c4c8bf086325a3d5b6d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:27:59.998251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-f4b6b185-e0a8-43a9-aae3-84c83074641d None None] MFA Rules not processed for user `c28c36dcf30d4d90948d31b6df57981c`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:00.000055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f4b6b185-e0a8-43a9-aae3-84c83074641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.007027 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec532218ae994c4c8bf086325a3d5b6d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:00.007827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec532218ae994c4c8bf086325a3d5b6d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:00.018874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec532218ae994c4c8bf086325a3d5b6d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:00.028839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec532218ae994c4c8bf086325a3d5b6d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:00.044066 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 944/1868] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:27:59 2022] DELETE /identity/v3/users/ec532218ae994c4c8bf086325a3d5b6d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:00.044066 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.045703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.084767 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 925/1869] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:27:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:00.085698 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6b185-e0a8-43a9-aae3-84c83074641d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.087077 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f4b6b185-e0a8-43a9-aae3-84c83074641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.100670 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6b185-e0a8-43a9-aae3-84c83074641d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.119625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ac4df-4464-4674-bf47-9d03f4e5dbfd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.125969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff4e8b-635f-4df1-84be-38931476b44f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.126619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff4e8b-635f-4df1-84be-38931476b44f service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.126900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff4e8b-635f-4df1-84be-38931476b44f service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.127182 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff4e8b-635f-4df1-84be-38931476b44f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.129004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9aff4e8b-635f-4df1-84be-38931476b44f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.141415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff4e8b-635f-4df1-84be-38931476b44f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.143005 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff4e8b-635f-4df1-84be-38931476b44f service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.153975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 945/1870] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:00.155280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dde6ee-7e3f-4a0c-93fd-bdfbc5c3d654 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.155506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dde6ee-7e3f-4a0c-93fd-bdfbc5c3d654 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.156173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d6a2b-a896-4add-865c-7c343ba20b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.156391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dde6ee-7e3f-4a0c-93fd-bdfbc5c3d654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.156840 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d6a2b-a896-4add-865c-7c343ba20b78 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.157118 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d6a2b-a896-4add-865c-7c343ba20b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.157393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d6a2b-a896-4add-865c-7c343ba20b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.158107 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d6a2b-a896-4add-865c-7c343ba20b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.159996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d6a2b-a896-4add-865c-7c343ba20b78 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.169911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 926/1871] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:00.174390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d6a2b-a896-4add-865c-7c343ba20b78 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.176406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c76d6a2b-a896-4add-865c-7c343ba20b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.182375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b8dde6ee-7e3f-4a0c-93fd-bdfbc5c3d654 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:00.183670 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b8dde6ee-7e3f-4a0c-93fd-bdfbc5c3d654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.193181 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 946/1872] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:00.194139 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dde6ee-7e3f-4a0c-93fd-bdfbc5c3d654 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.205940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dde6ee-7e3f-4a0c-93fd-bdfbc5c3d654 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.210654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c262c6a-4586-4845-8bbb-fc73ff6ccccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.211250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c262c6a-4586-4845-8bbb-fc73ff6ccccd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.211531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c262c6a-4586-4845-8bbb-fc73ff6ccccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.211805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c262c6a-4586-4845-8bbb-fc73ff6ccccd admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.212559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c262c6a-4586-4845-8bbb-fc73ff6ccccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.214251 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c262c6a-4586-4845-8bbb-fc73ff6ccccd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.224152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 947/1873] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:00.225146 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c262c6a-4586-4845-8bbb-fc73ff6ccccd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.226759 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4c262c6a-4586-4845-8bbb-fc73ff6ccccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.239605 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d6a2b-a896-4add-865c-7c343ba20b78 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.243225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff820e8-b04c-4197-91fe-d9206fa0de37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.243863 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff820e8-b04c-4197-91fe-d9206fa0de37 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.244172 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff820e8-b04c-4197-91fe-d9206fa0de37 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.244442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff820e8-b04c-4197-91fe-d9206fa0de37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.283003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c262c6a-4586-4845-8bbb-fc73ff6ccccd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.286760 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1ea9b-34eb-43cd-9d85-68166b77ed01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.287497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1ea9b-34eb-43cd-9d85-68166b77ed01 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.287849 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1ea9b-34eb-43cd-9d85-68166b77ed01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.288227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1ea9b-34eb-43cd-9d85-68166b77ed01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.297523 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1ea9b-34eb-43cd-9d85-68166b77ed01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.298941 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1ea9b-34eb-43cd-9d85-68166b77ed01 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.302484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff820e8-b04c-4197-91fe-d9206fa0de37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.303904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff820e8-b04c-4197-91fe-d9206fa0de37 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.308113 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 948/1874] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:00.308875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1ea9b-34eb-43cd-9d85-68166b77ed01 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.314185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 927/1875] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:00.318221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1ea9b-34eb-43cd-9d85-68166b77ed01 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.322964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76736f58-d3f3-460a-afe9-a13066b221b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.323820 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76736f58-d3f3-460a-afe9-a13066b221b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.324144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76736f58-d3f3-460a-afe9-a13066b221b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.324480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76736f58-d3f3-460a-afe9-a13066b221b6 admin admin] PATH_INFO: `/v3/projects/6910203e6bdc492a98f80ac6948c22d0/users/d9f79700dd2f4574a932a81b5bc2c967/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.349928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76736f58-d3f3-460a-afe9-a13066b221b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6910203e6bdc492a98f80ac6948c22d0, user_id=d9f79700dd2f4574a932a81b5bc2c967, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.352872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76736f58-d3f3-460a-afe9-a13066b221b6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.373773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 949/1876] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:00 2022] PUT /identity/v3/projects/6910203e6bdc492a98f80ac6948c22d0/users/d9f79700dd2f4574a932a81b5bc2c967/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:00.385363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653edef4-fee8-46e1-9eda-4e44e5f67e57 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.385862 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653edef4-fee8-46e1-9eda-4e44e5f67e57 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.386482 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653edef4-fee8-46e1-9eda-4e44e5f67e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.398647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76736f58-d3f3-460a-afe9-a13066b221b6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.400586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-76736f58-d3f3-460a-afe9-a13066b221b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.420998 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-653edef4-fee8-46e1-9eda-4e44e5f67e57 None None] MFA Rules not processed for user `d9f79700dd2f4574a932a81b5bc2c967`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:00.422601 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-653edef4-fee8-46e1-9eda-4e44e5f67e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.489068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76736f58-d3f3-460a-afe9-a13066b221b6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.495232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de294ff-b090-4b15-9c21-5e96a9b56190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.496628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de294ff-b090-4b15-9c21-5e96a9b56190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.496983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de294ff-b090-4b15-9c21-5e96a9b56190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.497323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de294ff-b090-4b15-9c21-5e96a9b56190 admin admin] PATH_INFO: `/v3/users/585200a8b17547eaa73316848e02d73a` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.498987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de294ff-b090-4b15-9c21-5e96a9b56190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=585200a8b17547eaa73316848e02d73a)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.502363 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de294ff-b090-4b15-9c21-5e96a9b56190 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.520778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 928/1877] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:00.522215 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653edef4-fee8-46e1-9eda-4e44e5f67e57 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.535960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653edef4-fee8-46e1-9eda-4e44e5f67e57 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.542383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618963-b062-498b-a0cb-58d3bb5d3815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.543060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618963-b062-498b-a0cb-58d3bb5d3815 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.543345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618963-b062-498b-a0cb-58d3bb5d3815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.543722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618963-b062-498b-a0cb-58d3bb5d3815 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.544476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df618963-b062-498b-a0cb-58d3bb5d3815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.547016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df618963-b062-498b-a0cb-58d3bb5d3815 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.572420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4de294ff-b090-4b15-9c21-5e96a9b56190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585200a8b17547eaa73316848e02d73a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:00.582941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 929/1878] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:00 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:00.584321 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618963-b062-498b-a0cb-58d3bb5d3815 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.585148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4de294ff-b090-4b15-9c21-5e96a9b56190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585200a8b17547eaa73316848e02d73a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:00.585906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4de294ff-b090-4b15-9c21-5e96a9b56190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585200a8b17547eaa73316848e02d73a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:00.598148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4de294ff-b090-4b15-9c21-5e96a9b56190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585200a8b17547eaa73316848e02d73a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:00.607881 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4de294ff-b090-4b15-9c21-5e96a9b56190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585200a8b17547eaa73316848e02d73a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:00.617315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 950/1879] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:00 2022] DELETE /identity/v3/users/585200a8b17547eaa73316848e02d73a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:00.624422 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7a329-f2bd-473f-827f-7035108a09dc None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.624422 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7a329-f2bd-473f-827f-7035108a09dc None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.624422 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7a329-f2bd-473f-827f-7035108a09dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.652189 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-39b7a329-f2bd-473f-827f-7035108a09dc None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:00.653691 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-39b7a329-f2bd-473f-827f-7035108a09dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.661864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df618963-b062-498b-a0cb-58d3bb5d3815 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.722562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74633ac9-88f4-45fe-a101-bf9a12660b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.723158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74633ac9-88f4-45fe-a101-bf9a12660b77 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.723447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74633ac9-88f4-45fe-a101-bf9a12660b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.723724 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74633ac9-88f4-45fe-a101-bf9a12660b77 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.724514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74633ac9-88f4-45fe-a101-bf9a12660b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.726686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74633ac9-88f4-45fe-a101-bf9a12660b77 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.730440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 951/1880] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:00.741125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7a329-f2bd-473f-827f-7035108a09dc None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.742959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-39b7a329-f2bd-473f-827f-7035108a09dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.752342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 930/1881] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:00 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:00.756767 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74633ac9-88f4-45fe-a101-bf9a12660b77 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.758773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-74633ac9-88f4-45fe-a101-bf9a12660b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.772284 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74633ac9-88f4-45fe-a101-bf9a12660b77 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.777674 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6280f7-de14-4572-9308-98d0520e2ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.778345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6280f7-de14-4572-9308-98d0520e2ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.778974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6280f7-de14-4572-9308-98d0520e2ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.779085 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6280f7-de14-4572-9308-98d0520e2ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.779887 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6280f7-de14-4572-9308-98d0520e2ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.781788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6280f7-de14-4572-9308-98d0520e2ca4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.795406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 931/1882] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:00.797017 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6280f7-de14-4572-9308-98d0520e2ca4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.807157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7a329-f2bd-473f-827f-7035108a09dc None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.808313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6280f7-de14-4572-9308-98d0520e2ca4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.811653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250ce92-7fcd-4859-940d-9217236e2cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.812569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ce92-7fcd-4859-940d-9217236e2cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.812859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ce92-7fcd-4859-940d-9217236e2cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.813193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250ce92-7fcd-4859-940d-9217236e2cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.815058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a40b2d-7f28-4a75-89b3-fb985b1843d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.816158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a40b2d-7f28-4a75-89b3-fb985b1843d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.816442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a40b2d-7f28-4a75-89b3-fb985b1843d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.816766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a40b2d-7f28-4a75-89b3-fb985b1843d4 admin admin] PATH_INFO: `/v3/projects/d9d8877975bf4e34b19b554f547d7548/users/43a5d823041a40f5ae3d8e7151adb0a4/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.823929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250ce92-7fcd-4859-940d-9217236e2cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.825809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250ce92-7fcd-4859-940d-9217236e2cf4 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.837768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 952/1883] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:00.838785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a40b2d-7f28-4a75-89b3-fb985b1843d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d8877975bf4e34b19b554f547d7548, user_id=43a5d823041a40f5ae3d8e7151adb0a4, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.842061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a40b2d-7f28-4a75-89b3-fb985b1843d4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.855329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250ce92-7fcd-4859-940d-9217236e2cf4 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.859460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9250ce92-7fcd-4859-940d-9217236e2cf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:00.867476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 932/1884] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:00 2022] PUT /identity/v3/projects/d9d8877975bf4e34b19b554f547d7548/users/43a5d823041a40f5ae3d8e7151adb0a4/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:00.872891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a40b2d-7f28-4a75-89b3-fb985b1843d4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.889737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250ce92-7fcd-4859-940d-9217236e2cf4 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.958918 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a40b2d-7f28-4a75-89b3-fb985b1843d4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:00.966029 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90049f26-7e16-4fc7-8c0f-856a046ab514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.967161 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90049f26-7e16-4fc7-8c0f-856a046ab514 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.967654 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90049f26-7e16-4fc7-8c0f-856a046ab514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.968291 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90049f26-7e16-4fc7-8c0f-856a046ab514 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.969303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90049f26-7e16-4fc7-8c0f-856a046ab514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:00.971319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90049f26-7e16-4fc7-8c0f-856a046ab514 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:00.985019 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 933/1885] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:00.989362 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90049f26-7e16-4fc7-8c0f-856a046ab514 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:00.992803 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:00.994592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:00.995164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:00.995588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] PATH_INFO: `/v3/projects/13b13ed801b74f4fb9367ef45776d947` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:00.997177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b13ed801b74f4fb9367ef45776d947)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:01.000503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:01.001213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90049f26-7e16-4fc7-8c0f-856a046ab514 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:01.006916 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4cb978-c097-42f1-9326-d2ef4d05b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:01.008186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cb978-c097-42f1-9326-d2ef4d05b180 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:01.008575 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cb978-c097-42f1-9326-d2ef4d05b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:01.009111 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4cb978-c097-42f1-9326-d2ef4d05b180 admin admin] PATH_INFO: `/v3/projects/d9d8877975bf4e34b19b554f547d7548/users/43a5d823041a40f5ae3d8e7151adb0a4/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:01.019256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cb978-c097-42f1-9326-d2ef4d05b180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d8877975bf4e34b19b554f547d7548, user_id=43a5d823041a40f5ae3d8e7151adb0a4, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:01.022178 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4cb978-c097-42f1-9326-d2ef4d05b180 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:01.044089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 934/1886] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:00 2022] PUT /identity/v3/projects/d9d8877975bf4e34b19b554f547d7548/users/43a5d823041a40f5ae3d8e7151adb0a4/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:01.054908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ced75-2e65-4e5f-8819-2329b067e320 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:01.055758 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ced75-2e65-4e5f-8819-2329b067e320 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:01.056308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ced75-2e65-4e5f-8819-2329b067e320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:01.084715 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b13ed801b74f4fb9367ef45776d947', 'request_id': 'req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.092370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b13ed801b74f4fb9367ef45776d947', 'request_id': 'req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.103236 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b13ed801b74f4fb9367ef45776d947', 'request_id': 'req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.103582 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-6f0ced75-2e65-4e5f-8819-2329b067e320 None None] MFA Rules not processed for user `43a5d823041a40f5ae3d8e7151adb0a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:01.105097 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6f0ced75-2e65-4e5f-8819-2329b067e320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:01.123300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] The token cache is being invalidate because project 13b13ed801b74f4fb9367ef45776d947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:01.123495 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.124635 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.126679 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 953/1887] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:00 2022] DELETE /identity/v3/projects/13b13ed801b74f4fb9367ef45776d947 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:01.130525 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:01.132156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:01.210129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 935/1888] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:01.220065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ced75-2e65-4e5f-8819-2329b067e320 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:01.221666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6f0ced75-2e65-4e5f-8819-2329b067e320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:01.233719 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066645a6-7d4b-4cfc-8d52-b26ee9fc8972 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:01.240509 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:01.241321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:01.241608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:01.241884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] PATH_INFO: `/v3/users/b429be5be9d44a6185fa45daf1f9c1cc` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:01.243107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b429be5be9d44a6185fa45daf1f9c1cc)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:01.245091 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:01.286790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ced75-2e65-4e5f-8819-2329b067e320 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:01.290565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f652be-1da3-4df9-9a20-1345bee5adb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:01.291210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f652be-1da3-4df9-9a20-1345bee5adb7 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:01.291496 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f652be-1da3-4df9-9a20-1345bee5adb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:01.291775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f652be-1da3-4df9-9a20-1345bee5adb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:01.293285 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b429be5be9d44a6185fa45daf1f9c1cc'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.293720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-83f652be-1da3-4df9-9a20-1345bee5adb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:01.305309 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b429be5be9d44a6185fa45daf1f9c1cc'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.305994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b429be5be9d44a6185fa45daf1f9c1cc'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.313756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b429be5be9d44a6185fa45daf1f9c1cc'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.320511 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b429be5be9d44a6185fa45daf1f9c1cc'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.326680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 954/1889] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:01 2022] DELETE /identity/v3/users/b429be5be9d44a6185fa45daf1f9c1cc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:01.327283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:01.329392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:01.353961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f652be-1da3-4df9-9a20-1345bee5adb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:01.355464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f652be-1da3-4df9-9a20-1345bee5adb7 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:01.364827 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 936/1890] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:28:01.400017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e74d02-9647-41ca-87b7-3234eb44c607 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:01.405520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:01.407081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:01.407404 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:01.407639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] PATH_INFO: `/v3/projects/b586f2a880b94ee7a7781a9a48ba4c87` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:01.409184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b586f2a880b94ee7a7781a9a48ba4c87)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:01.411773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:01.465207 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b586f2a880b94ee7a7781a9a48ba4c87', 'request_id': 'req-84d373c8-c01e-496a-ba17-3da92167b86d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.473090 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b586f2a880b94ee7a7781a9a48ba4c87', 'request_id': 'req-84d373c8-c01e-496a-ba17-3da92167b86d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.482667 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b586f2a880b94ee7a7781a9a48ba4c87', 'request_id': 'req-84d373c8-c01e-496a-ba17-3da92167b86d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.502247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] The token cache is being invalidate because project b586f2a880b94ee7a7781a9a48ba4c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:01.502688 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.503438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.508052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 955/1891] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:01 2022] DELETE /identity/v3/projects/b586f2a880b94ee7a7781a9a48ba4c87 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:01.509281 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f652be-1da3-4df9-9a20-1345bee5adb7 service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:01.510739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-83f652be-1da3-4df9-9a20-1345bee5adb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:01.527167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f652be-1da3-4df9-9a20-1345bee5adb7 service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:01.596846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b22e0-e95c-4762-8cb3-25e8b5ba0217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:01.598064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b22e0-e95c-4762-8cb3-25e8b5ba0217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:01.598387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b22e0-e95c-4762-8cb3-25e8b5ba0217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:01.598712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b22e0-e95c-4762-8cb3-25e8b5ba0217 admin admin] PATH_INFO: `/v3/users/c28c36dcf30d4d90948d31b6df57981c` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:01.600216 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b22e0-e95c-4762-8cb3-25e8b5ba0217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28c36dcf30d4d90948d31b6df57981c)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:01.602516 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b22e0-e95c-4762-8cb3-25e8b5ba0217 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:01.613958 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:01.615524 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:01.659618 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d373c8-c01e-496a-ba17-3da92167b86d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:01.665511 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac27603-146d-43c7-a231-d3a40b09b0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:01.666446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac27603-146d-43c7-a231-d3a40b09b0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:01.668294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac27603-146d-43c7-a231-d3a40b09b0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:01.668656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac27603-146d-43c7-a231-d3a40b09b0f3 admin admin] PATH_INFO: `/v3/projects/7488e757dcd34ec7b2cae92ae18a01f4` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:01.670307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac27603-146d-43c7-a231-d3a40b09b0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7488e757dcd34ec7b2cae92ae18a01f4)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:01.672552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac27603-146d-43c7-a231-d3a40b09b0f3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:01.681315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-157b22e0-e95c-4762-8cb3-25e8b5ba0217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28c36dcf30d4d90948d31b6df57981c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.696181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-157b22e0-e95c-4762-8cb3-25e8b5ba0217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28c36dcf30d4d90948d31b6df57981c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.706959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-157b22e0-e95c-4762-8cb3-25e8b5ba0217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28c36dcf30d4d90948d31b6df57981c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.724184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-157b22e0-e95c-4762-8cb3-25e8b5ba0217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28c36dcf30d4d90948d31b6df57981c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.724924 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-157b22e0-e95c-4762-8cb3-25e8b5ba0217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28c36dcf30d4d90948d31b6df57981c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.730221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2ac27603-146d-43c7-a231-d3a40b09b0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7488e757dcd34ec7b2cae92ae18a01f4', 'request_id': 'req-2ac27603-146d-43c7-a231-d3a40b09b0f3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.731627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 937/1892] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:01 2022] DELETE /identity/v3/users/c28c36dcf30d4d90948d31b6df57981c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:01.737309 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2ac27603-146d-43c7-a231-d3a40b09b0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7488e757dcd34ec7b2cae92ae18a01f4', 'request_id': 'req-2ac27603-146d-43c7-a231-d3a40b09b0f3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.743887 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2ac27603-146d-43c7-a231-d3a40b09b0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7488e757dcd34ec7b2cae92ae18a01f4', 'request_id': 'req-2ac27603-146d-43c7-a231-d3a40b09b0f3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.759686 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2ac27603-146d-43c7-a231-d3a40b09b0f3 admin admin] The token cache is being invalidate because project 7488e757dcd34ec7b2cae92ae18a01f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:01.759980 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2ac27603-146d-43c7-a231-d3a40b09b0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.760847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2ac27603-146d-43c7-a231-d3a40b09b0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:01.762648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 956/1893] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:01 2022] DELETE /identity/v3/projects/7488e757dcd34ec7b2cae92ae18a01f4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:01.768096 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f7d0b-075f-408c-be32-3b575881e08b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:01.768394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f7d0b-075f-408c-be32-3b575881e08b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:01.768741 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f7d0b-075f-408c-be32-3b575881e08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:01.789326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a76f7d0b-075f-408c-be32-3b575881e08b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:01.790551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a76f7d0b-075f-408c-be32-3b575881e08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:01.866444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 938/1894] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:01.874011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0872d75-3e9c-4427-9d3e-9cf868ea9aba None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:01.874865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0872d75-3e9c-4427-9d3e-9cf868ea9aba None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:01.875136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0872d75-3e9c-4427-9d3e-9cf868ea9aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:01.905664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a0872d75-3e9c-4427-9d3e-9cf868ea9aba None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:01.907274 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a0872d75-3e9c-4427-9d3e-9cf868ea9aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:01.923583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 957/1895] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:01.927472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f7d0b-075f-408c-be32-3b575881e08b None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:01.943343 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f7d0b-075f-408c-be32-3b575881e08b None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:01.950510 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac518e-75be-4b59-ab92-dcf98c41f19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:01.951291 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac518e-75be-4b59-ab92-dcf98c41f19b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:01.951665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac518e-75be-4b59-ab92-dcf98c41f19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:01.952046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac518e-75be-4b59-ab92-dcf98c41f19b admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:01.954472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac518e-75be-4b59-ab92-dcf98c41f19b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:01.954472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac518e-75be-4b59-ab92-dcf98c41f19b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:01.956812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac518e-75be-4b59-ab92-dcf98c41f19b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:01.970981 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 939/1896] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:28:01.975270 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0872d75-3e9c-4427-9d3e-9cf868ea9aba None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:01.986620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0872d75-3e9c-4427-9d3e-9cf868ea9aba None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:01.994554 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cec7e5-450a-46cf-bbda-f90aaa2ebb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:01.995157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cec7e5-450a-46cf-bbda-f90aaa2ebb41 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:01.995609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cec7e5-450a-46cf-bbda-f90aaa2ebb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:01.995879 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cec7e5-450a-46cf-bbda-f90aaa2ebb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:01.996700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cec7e5-450a-46cf-bbda-f90aaa2ebb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:01.999697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cec7e5-450a-46cf-bbda-f90aaa2ebb41 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.025421 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac518e-75be-4b59-ab92-dcf98c41f19b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.027601 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8fac518e-75be-4b59-ab92-dcf98c41f19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:02.042389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac518e-75be-4b59-ab92-dcf98c41f19b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.044384 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 958/1897] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:01 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:02.048997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cec7e5-450a-46cf-bbda-f90aaa2ebb41 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.117213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cec7e5-450a-46cf-bbda-f90aaa2ebb41 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.121240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95260a4d-3080-4408-b6de-c0f9e4267621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.122056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0ad27-22a9-4e07-9ab7-4b38b7e5f345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.122181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95260a4d-3080-4408-b6de-c0f9e4267621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.122371 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95260a4d-3080-4408-b6de-c0f9e4267621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.123157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95260a4d-3080-4408-b6de-c0f9e4267621 admin admin] PATH_INFO: `/v3/projects/4b1e604bb8914cff8210fa80ad0c66d4` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.123302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0ad27-22a9-4e07-9ab7-4b38b7e5f345 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.123302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0ad27-22a9-4e07-9ab7-4b38b7e5f345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.123439 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0ad27-22a9-4e07-9ab7-4b38b7e5f345 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.123779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95260a4d-3080-4408-b6de-c0f9e4267621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1e604bb8914cff8210fa80ad0c66d4)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.124060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0ad27-22a9-4e07-9ab7-4b38b7e5f345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.126331 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95260a4d-3080-4408-b6de-c0f9e4267621 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.126648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0ad27-22a9-4e07-9ab7-4b38b7e5f345 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.158308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 959/1898] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:02 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:02.162258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0ad27-22a9-4e07-9ab7-4b38b7e5f345 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.174739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0ad27-22a9-4e07-9ab7-4b38b7e5f345 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.180645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-95260a4d-3080-4408-b6de-c0f9e4267621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1e604bb8914cff8210fa80ad0c66d4', 'request_id': 'req-95260a4d-3080-4408-b6de-c0f9e4267621'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:02.186000 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-95260a4d-3080-4408-b6de-c0f9e4267621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1e604bb8914cff8210fa80ad0c66d4', 'request_id': 'req-95260a4d-3080-4408-b6de-c0f9e4267621'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:02.194097 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-95260a4d-3080-4408-b6de-c0f9e4267621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1e604bb8914cff8210fa80ad0c66d4', 'request_id': 'req-95260a4d-3080-4408-b6de-c0f9e4267621'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:02.207782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-95260a4d-3080-4408-b6de-c0f9e4267621 admin admin] The token cache is being invalidate because project 4b1e604bb8914cff8210fa80ad0c66d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:02.208102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-95260a4d-3080-4408-b6de-c0f9e4267621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:02.208762 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-95260a4d-3080-4408-b6de-c0f9e4267621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:02.210351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 940/1899] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:02 2022] DELETE /identity/v3/projects/4b1e604bb8914cff8210fa80ad0c66d4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:02.217580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2513eb-f68c-4cba-9266-a3daf1c47f72 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.217998 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2513eb-f68c-4cba-9266-a3daf1c47f72 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.218755 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2513eb-f68c-4cba-9266-a3daf1c47f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.239683 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-ce2513eb-f68c-4cba-9266-a3daf1c47f72 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:02.241146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ce2513eb-f68c-4cba-9266-a3daf1c47f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:02.262553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ab15f-3b85-4219-9f35-5164fd807e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.262553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ab15f-3b85-4219-9f35-5164fd807e28 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.262846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ab15f-3b85-4219-9f35-5164fd807e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.263062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ab15f-3b85-4219-9f35-5164fd807e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.263788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ab15f-3b85-4219-9f35-5164fd807e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.265621 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ab15f-3b85-4219-9f35-5164fd807e28 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.278877 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 960/1900] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:28:02.280101 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ab15f-3b85-4219-9f35-5164fd807e28 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.282259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-655ab15f-3b85-4219-9f35-5164fd807e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:02.295978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ab15f-3b85-4219-9f35-5164fd807e28 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.301537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9e3c2-da5f-4174-8f26-2e361455f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.302258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9e3c2-da5f-4174-8f26-2e361455f057 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.302542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9e3c2-da5f-4174-8f26-2e361455f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.302821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9e3c2-da5f-4174-8f26-2e361455f057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.304193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9e3c2-da5f-4174-8f26-2e361455f057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.305392 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 941/1901] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:02.305508 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9e3c2-da5f-4174-8f26-2e361455f057 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.314606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0f45c-8a41-4544-ad2a-5a68d2fd2fd1 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.315105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0f45c-8a41-4544-ad2a-5a68d2fd2fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.315394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f0f45c-8a41-4544-ad2a-5a68d2fd2fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.323504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 961/1902] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:02.323786 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9e3c2-da5f-4174-8f26-2e361455f057 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.333786 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9e3c2-da5f-4174-8f26-2e361455f057 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.334032 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-30f0f45c-8a41-4544-ad2a-5a68d2fd2fd1 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:02.335384 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-30f0f45c-8a41-4544-ad2a-5a68d2fd2fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:02.338723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc47f6-f6b1-4c39-abb8-fe6142da2389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.339600 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc47f6-f6b1-4c39-abb8-fe6142da2389 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.340011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc47f6-f6b1-4c39-abb8-fe6142da2389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.340381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc47f6-f6b1-4c39-abb8-fe6142da2389 admin admin] PATH_INFO: `/v3/projects/adc19d4802d9428cb5239d274508c01b/users/1988f56160b848179886a1f7b56762a8/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.349056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 942/1903] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:02.349955 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0f45c-8a41-4544-ad2a-5a68d2fd2fd1 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.357881 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc47f6-f6b1-4c39-abb8-fe6142da2389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc19d4802d9428cb5239d274508c01b, user_id=1988f56160b848179886a1f7b56762a8, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.359498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f0f45c-8a41-4544-ad2a-5a68d2fd2fd1 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.361458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc47f6-f6b1-4c39-abb8-fe6142da2389 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.364795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60366b-ffa6-4c6a-b250-8003b4fe66b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.365624 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60366b-ffa6-4c6a-b250-8003b4fe66b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.365808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60366b-ffa6-4c6a-b250-8003b4fe66b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.366078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60366b-ffa6-4c6a-b250-8003b4fe66b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.367036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60366b-ffa6-4c6a-b250-8003b4fe66b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:02.367387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60366b-ffa6-4c6a-b250-8003b4fe66b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.369400 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60366b-ffa6-4c6a-b250-8003b4fe66b1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.385288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 962/1904] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:02 2022] PUT /identity/v3/projects/adc19d4802d9428cb5239d274508c01b/users/1988f56160b848179886a1f7b56762a8/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:02.385470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 943/1905] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:28:02.386332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc47f6-f6b1-4c39-abb8-fe6142da2389 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.388304 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a25e9-1b1a-407a-bfbd-45815d86d008 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.388440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a25e9-1b1a-407a-bfbd-45815d86d008 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.388697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a25e9-1b1a-407a-bfbd-45815d86d008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.418193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-661a25e9-1b1a-407a-bfbd-45815d86d008 None None] MFA Rules not processed for user `1988f56160b848179886a1f7b56762a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:02.419452 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-661a25e9-1b1a-407a-bfbd-45815d86d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:02.461045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc47f6-f6b1-4c39-abb8-fe6142da2389 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.466103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae881c-b8fe-4651-bf49-a7378562efdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.466782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae881c-b8fe-4651-bf49-a7378562efdf admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.467056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae881c-b8fe-4651-bf49-a7378562efdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.467330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae881c-b8fe-4651-bf49-a7378562efdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.468729 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae881c-b8fe-4651-bf49-a7378562efdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.470992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae881c-b8fe-4651-bf49-a7378562efdf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.499738 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 963/1906] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:02 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:02.499932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 944/1907] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:02.500975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae881c-b8fe-4651-bf49-a7378562efdf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.502207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a25e9-1b1a-407a-bfbd-45815d86d008 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.512163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a25e9-1b1a-407a-bfbd-45815d86d008 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.561968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae881c-b8fe-4651-bf49-a7378562efdf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.566635 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c067e71-b1c3-4aac-897e-d1025d997978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.567307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c067e71-b1c3-4aac-897e-d1025d997978 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.567594 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c067e71-b1c3-4aac-897e-d1025d997978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.567989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c067e71-b1c3-4aac-897e-d1025d997978 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.568713 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c067e71-b1c3-4aac-897e-d1025d997978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.569521 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dba489-e31f-4601-a438-86fc52b0704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.570174 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dba489-e31f-4601-a438-86fc52b0704b admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.570456 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dba489-e31f-4601-a438-86fc52b0704b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.570654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c067e71-b1c3-4aac-897e-d1025d997978 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.570753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dba489-e31f-4601-a438-86fc52b0704b admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.571391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dba489-e31f-4601-a438-86fc52b0704b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.573289 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dba489-e31f-4601-a438-86fc52b0704b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.591198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 964/1908] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:02 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:02.595971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c067e71-b1c3-4aac-897e-d1025d997978 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.602715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 945/1909] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:02 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:02.603665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dba489-e31f-4601-a438-86fc52b0704b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.605390 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c067e71-b1c3-4aac-897e-d1025d997978 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.663209 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfe32d-2bbe-4f2a-8b34-9184084fcbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.664081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfe32d-2bbe-4f2a-8b34-9184084fcbdd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.664377 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfe32d-2bbe-4f2a-8b34-9184084fcbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.664704 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfe32d-2bbe-4f2a-8b34-9184084fcbdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.665141 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dba489-e31f-4601-a438-86fc52b0704b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.665837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfe32d-2bbe-4f2a-8b34-9184084fcbdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.667271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfe32d-2bbe-4f2a-8b34-9184084fcbdd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.670333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a03a9-ad50-4c1d-ac60-081f08edc35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.670883 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a03a9-ad50-4c1d-ac60-081f08edc35c admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.671223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a03a9-ad50-4c1d-ac60-081f08edc35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.672092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a03a9-ad50-4c1d-ac60-081f08edc35c admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.672913 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a03a9-ad50-4c1d-ac60-081f08edc35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.674974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a03a9-ad50-4c1d-ac60-081f08edc35c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.683134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 965/1910] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:28:02.683929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfe32d-2bbe-4f2a-8b34-9184084fcbdd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.694394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfe32d-2bbe-4f2a-8b34-9184084fcbdd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.700717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 946/1911] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:02 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:02.700854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc56345-3886-4321-9a40-6267a99e85e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.700854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc56345-3886-4321-9a40-6267a99e85e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.701056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc56345-3886-4321-9a40-6267a99e85e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.701243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc56345-3886-4321-9a40-6267a99e85e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.701928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a03a9-ad50-4c1d-ac60-081f08edc35c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.702066 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc56345-3886-4321-9a40-6267a99e85e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.704334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc56345-3886-4321-9a40-6267a99e85e0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.712614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a03a9-ad50-4c1d-ac60-081f08edc35c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.717621 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c731ea-02ef-4235-a523-a52f520223bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.718322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 966/1912] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:02.718503 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c731ea-02ef-4235-a523-a52f520223bd admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.718740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c731ea-02ef-4235-a523-a52f520223bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.718975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc56345-3886-4321-9a40-6267a99e85e0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.719072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c731ea-02ef-4235-a523-a52f520223bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.721095 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c731ea-02ef-4235-a523-a52f520223bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.721582 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c731ea-02ef-4235-a523-a52f520223bd admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.730867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc56345-3886-4321-9a40-6267a99e85e0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.732386 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 947/1913] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:02.737468 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c731ea-02ef-4235-a523-a52f520223bd admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.738032 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17924f43-5847-47d4-97dc-7a714c5dad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.739461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17924f43-5847-47d4-97dc-7a714c5dad22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.739892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17924f43-5847-47d4-97dc-7a714c5dad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.740354 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17924f43-5847-47d4-97dc-7a714c5dad22 admin admin] PATH_INFO: `/v3/projects/2d88e1dfeea241398f5b0fee2f97e03b/users/831ae0dc51e2417198b7f01b15b6ad5f/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.748121 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c731ea-02ef-4235-a523-a52f520223bd admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.756729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d00cdf-a1da-49b3-bf3d-1d035a977a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.757631 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d00cdf-a1da-49b3-bf3d-1d035a977a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.757908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d00cdf-a1da-49b3-bf3d-1d035a977a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.758185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d00cdf-a1da-49b3-bf3d-1d035a977a5a admin admin] PATH_INFO: `/v3/projects/a888e9da7e794ecb8237f6621b1675c8/users/abbccec4d533469f8eba025bbadcebb7/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.764662 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17924f43-5847-47d4-97dc-7a714c5dad22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d88e1dfeea241398f5b0fee2f97e03b, user_id=831ae0dc51e2417198b7f01b15b6ad5f, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.767476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17924f43-5847-47d4-97dc-7a714c5dad22 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.781905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d00cdf-a1da-49b3-bf3d-1d035a977a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a888e9da7e794ecb8237f6621b1675c8, user_id=abbccec4d533469f8eba025bbadcebb7, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.781905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d00cdf-a1da-49b3-bf3d-1d035a977a5a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.787888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 967/1914] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:02 2022] PUT /identity/v3/projects/2d88e1dfeea241398f5b0fee2f97e03b/users/831ae0dc51e2417198b7f01b15b6ad5f/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:02.794814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f45f00-6af5-4839-a4a3-7b473a633041 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.795106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f45f00-6af5-4839-a4a3-7b473a633041 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.795399 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f45f00-6af5-4839-a4a3-7b473a633041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.800693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 948/1915] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:02 2022] PUT /identity/v3/projects/a888e9da7e794ecb8237f6621b1675c8/users/abbccec4d533469f8eba025bbadcebb7/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:02.804375 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d00cdf-a1da-49b3-bf3d-1d035a977a5a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.825593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-82f45f00-6af5-4839-a4a3-7b473a633041 None None] MFA Rules not processed for user `831ae0dc51e2417198b7f01b15b6ad5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:02.827100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-82f45f00-6af5-4839-a4a3-7b473a633041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:02.871633 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d00cdf-a1da-49b3-bf3d-1d035a977a5a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.877359 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245be77-795f-4492-a491-7563d0543d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.878027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245be77-795f-4492-a491-7563d0543d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.878308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245be77-795f-4492-a491-7563d0543d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.878579 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245be77-795f-4492-a491-7563d0543d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.879296 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245be77-795f-4492-a491-7563d0543d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.880918 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245be77-795f-4492-a491-7563d0543d29 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.891090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 949/1916] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:28:02.897393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 968/1917] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:02.898610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245be77-795f-4492-a491-7563d0543d29 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.898728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f45f00-6af5-4839-a4a3-7b473a633041 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.911290 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f45f00-6af5-4839-a4a3-7b473a633041 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.916750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245be77-795f-4492-a491-7563d0543d29 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:02.918641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d42113-55bc-4615-8b97-7634773a2fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.919443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d42113-55bc-4615-8b97-7634773a2fea admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.919782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d42113-55bc-4615-8b97-7634773a2fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.920097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d42113-55bc-4615-8b97-7634773a2fea admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.920798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d42113-55bc-4615-8b97-7634773a2fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.923472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca1e63-6ca8-4ca7-851d-3f5781921575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:02.923612 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d42113-55bc-4615-8b97-7634773a2fea admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.924593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca1e63-6ca8-4ca7-851d-3f5781921575 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.925016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca1e63-6ca8-4ca7-851d-3f5781921575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.925762 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca1e63-6ca8-4ca7-851d-3f5781921575 admin admin] PATH_INFO: `/v3/projects/a888e9da7e794ecb8237f6621b1675c8/users/abbccec4d533469f8eba025bbadcebb7/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.927542 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca1e63-6ca8-4ca7-851d-3f5781921575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a888e9da7e794ecb8237f6621b1675c8, user_id=abbccec4d533469f8eba025bbadcebb7, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:02.930641 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca1e63-6ca8-4ca7-851d-3f5781921575 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:02.945587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 950/1918] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:02 2022] PUT /identity/v3/projects/a888e9da7e794ecb8237f6621b1675c8/users/abbccec4d533469f8eba025bbadcebb7/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:02.953763 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 969/1919] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:02 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:02.957891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca1e63-6ca8-4ca7-851d-3f5781921575 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:02.965625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fb469-0e22-4bcf-824d-92b95e71ca75 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:02.965916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fb469-0e22-4bcf-824d-92b95e71ca75 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:02.966194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fb469-0e22-4bcf-824d-92b95e71ca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:02.994393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-769fb469-0e22-4bcf-824d-92b95e71ca75 None None] MFA Rules not processed for user `abbccec4d533469f8eba025bbadcebb7`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:02.995618 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-769fb469-0e22-4bcf-824d-92b95e71ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:03.048850 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca1e63-6ca8-4ca7-851d-3f5781921575 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:03.084095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 970/1920] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:03.095326 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fb469-0e22-4bcf-824d-92b95e71ca75 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:03.097130 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-769fb469-0e22-4bcf-824d-92b95e71ca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:03.117551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca121bfa-f335-43b9-ba9b-c1ee94586c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:03.118244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca121bfa-f335-43b9-ba9b-c1ee94586c14 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:03.118531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca121bfa-f335-43b9-ba9b-c1ee94586c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:03.118810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca121bfa-f335-43b9-ba9b-c1ee94586c14 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:03.120148 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca121bfa-f335-43b9-ba9b-c1ee94586c14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:03.122272 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca121bfa-f335-43b9-ba9b-c1ee94586c14 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:03.147240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 951/1921] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:02 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:03.151467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca121bfa-f335-43b9-ba9b-c1ee94586c14 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:03.163523 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca121bfa-f335-43b9-ba9b-c1ee94586c14 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:03.163994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fb469-0e22-4bcf-824d-92b95e71ca75 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:03.167948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604771a9-1c88-4e12-bd2e-b5152f87c05a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:03.168445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d973e6-7688-4e40-9a8d-a12c9ae84033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:03.168664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604771a9-1c88-4e12-bd2e-b5152f87c05a service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:03.168950 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604771a9-1c88-4e12-bd2e-b5152f87c05a service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:03.169169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d973e6-7688-4e40-9a8d-a12c9ae84033 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:03.169260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604771a9-1c88-4e12-bd2e-b5152f87c05a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:03.169450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d973e6-7688-4e40-9a8d-a12c9ae84033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:03.169733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d973e6-7688-4e40-9a8d-a12c9ae84033 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:03.170529 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d973e6-7688-4e40-9a8d-a12c9ae84033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:03.172726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d973e6-7688-4e40-9a8d-a12c9ae84033 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:03.179815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604771a9-1c88-4e12-bd2e-b5152f87c05a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:03.181400 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604771a9-1c88-4e12-bd2e-b5152f87c05a service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:03.188311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 952/1922] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:28:03.190051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d973e6-7688-4e40-9a8d-a12c9ae84033 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:03.192629 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 971/1923] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:03.200355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d973e6-7688-4e40-9a8d-a12c9ae84033 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:03.206584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc20848-8428-4b95-99b0-394d15e8deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:03.207500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc20848-8428-4b95-99b0-394d15e8deda admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:03.207781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc20848-8428-4b95-99b0-394d15e8deda admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:03.208142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc20848-8428-4b95-99b0-394d15e8deda admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:03.208862 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc20848-8428-4b95-99b0-394d15e8deda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:03.210446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc20848-8428-4b95-99b0-394d15e8deda admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:03.224755 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 953/1924] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:03.228534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604771a9-1c88-4e12-bd2e-b5152f87c05a service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:03.255127 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604771a9-1c88-4e12-bd2e-b5152f87c05a service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:03.263913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16534de-8e41-4f16-8849-e280dc6c2cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:03.265581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16534de-8e41-4f16-8849-e280dc6c2cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:03.266768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16534de-8e41-4f16-8849-e280dc6c2cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:03.267382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16534de-8e41-4f16-8849-e280dc6c2cf0 admin admin] PATH_INFO: `/v3/projects/367d54bafc2d42099dd57a492fefa749/users/936bdf9fbbff4175ba96ea0c10d02814/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:03.287466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc20848-8428-4b95-99b0-394d15e8deda admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:03.300659 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc20848-8428-4b95-99b0-394d15e8deda admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:03.306012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cd4ca-e041-47fa-b04d-b7ccc26bcf05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:03.306415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16534de-8e41-4f16-8849-e280dc6c2cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=367d54bafc2d42099dd57a492fefa749, user_id=936bdf9fbbff4175ba96ea0c10d02814, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:03.306898 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd4ca-e041-47fa-b04d-b7ccc26bcf05 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:03.307276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd4ca-e041-47fa-b04d-b7ccc26bcf05 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:03.307647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cd4ca-e041-47fa-b04d-b7ccc26bcf05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:03.311985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16534de-8e41-4f16-8849-e280dc6c2cf0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:03.340418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 972/1925] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:03 2022] PUT /identity/v3/projects/367d54bafc2d42099dd57a492fefa749/users/936bdf9fbbff4175ba96ea0c10d02814/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:03.344879 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff225964-a09f-4ab9-a328-b8d874cd8143 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:03.345664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff225964-a09f-4ab9-a328-b8d874cd8143 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:03.346728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff225964-a09f-4ab9-a328-b8d874cd8143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:03.385164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ff225964-a09f-4ab9-a328-b8d874cd8143 None None] MFA Rules not processed for user `936bdf9fbbff4175ba96ea0c10d02814`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:03.387150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ff225964-a09f-4ab9-a328-b8d874cd8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:03.390183 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cd4ca-e041-47fa-b04d-b7ccc26bcf05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:03.391623 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cd4ca-e041-47fa-b04d-b7ccc26bcf05 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:03.402156 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 954/1926] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:28:03.530613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 973/1927] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:03.540210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cd4ca-e041-47fa-b04d-b7ccc26bcf05 service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:03.563497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cd4ca-e041-47fa-b04d-b7ccc26bcf05 service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:03.662138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a4ac4-5514-40a3-8d90-72a505cb75be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:03.663176 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a4ac4-5514-40a3-8d90-72a505cb75be admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:03.663528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a4ac4-5514-40a3-8d90-72a505cb75be admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:03.664115 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a4ac4-5514-40a3-8d90-72a505cb75be admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:03.664812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a4ac4-5514-40a3-8d90-72a505cb75be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:03.667391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a4ac4-5514-40a3-8d90-72a505cb75be admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:03.702680 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 955/1928] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:03 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:03.706883 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff225964-a09f-4ab9-a328-b8d874cd8143 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:03.723662 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff225964-a09f-4ab9-a328-b8d874cd8143 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:03.824208 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a4ac4-5514-40a3-8d90-72a505cb75be admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:03.870953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb27d81-811f-4045-8fe4-0d12ac623b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:03.871625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb27d81-811f-4045-8fe4-0d12ac623b27 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:03.871934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb27d81-811f-4045-8fe4-0d12ac623b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:03.872254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb27d81-811f-4045-8fe4-0d12ac623b27 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:03.873008 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb27d81-811f-4045-8fe4-0d12ac623b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:03.877456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb27d81-811f-4045-8fe4-0d12ac623b27 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:03.918929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 974/1929] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:03 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:03.925048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb27d81-811f-4045-8fe4-0d12ac623b27 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:03.936208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb27d81-811f-4045-8fe4-0d12ac623b27 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:03.942188 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a4ac4-5514-40a3-8d90-72a505cb75be admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:03.947314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b9fbf-6c97-4db7-bd79-4fee1310dc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:03.948048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b9fbf-6c97-4db7-bd79-4fee1310dc31 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:03.948340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b9fbf-6c97-4db7-bd79-4fee1310dc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:03.948689 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b9fbf-6c97-4db7-bd79-4fee1310dc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:03.949624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b9fbf-6c97-4db7-bd79-4fee1310dc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:03.951227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b9fbf-6c97-4db7-bd79-4fee1310dc31 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:03.959048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:03.960336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:03.960919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:03.961371 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] PATH_INFO: `/v3/users/1988f56160b848179886a1f7b56762a8` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:03.962735 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1988f56160b848179886a1f7b56762a8)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:03.964942 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:03.974663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 975/1930] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:03.976188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b9fbf-6c97-4db7-bd79-4fee1310dc31 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:03.991773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b9fbf-6c97-4db7-bd79-4fee1310dc31 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:03.997712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465da6-925e-4dee-8d16-44e5a1a0bb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:03.998802 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465da6-925e-4dee-8d16-44e5a1a0bb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:03.999279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465da6-925e-4dee-8d16-44e5a1a0bb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:04.000319 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465da6-925e-4dee-8d16-44e5a1a0bb1f admin admin] PATH_INFO: `/v3/projects/f74a2c6814fb44a0a3093584093e4e0c/users/58829cc34e1a4cfdb637b0cc1f36d045/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:04.023518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe465da6-925e-4dee-8d16-44e5a1a0bb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74a2c6814fb44a0a3093584093e4e0c, user_id=58829cc34e1a4cfdb637b0cc1f36d045, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:04.027330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe465da6-925e-4dee-8d16-44e5a1a0bb1f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:04.049089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1988f56160b848179886a1f7b56762a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:04.059847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 976/1931] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:03 2022] PUT /identity/v3/projects/f74a2c6814fb44a0a3093584093e4e0c/users/58829cc34e1a4cfdb637b0cc1f36d045/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:04.060992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465da6-925e-4dee-8d16-44e5a1a0bb1f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:04.074476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1988f56160b848179886a1f7b56762a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:04.083744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1988f56160b848179886a1f7b56762a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:04.091051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1988f56160b848179886a1f7b56762a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:04.091725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1988f56160b848179886a1f7b56762a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:04.101903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 956/1932] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:03 2022] DELETE /identity/v3/users/1988f56160b848179886a1f7b56762a8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:04.101903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:04.101903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:04.142074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465da6-925e-4dee-8d16-44e5a1a0bb1f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:04.165721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b702d-e687-4787-a63f-a5de7efd9336 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:04.169496 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07860fa-0e4f-4b78-ac25-cdc45df3431d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:04.170145 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07860fa-0e4f-4b78-ac25-cdc45df3431d service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:04.170476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07860fa-0e4f-4b78-ac25-cdc45df3431d service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:04.170704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07860fa-0e4f-4b78-ac25-cdc45df3431d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:04.172694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c07860fa-0e4f-4b78-ac25-cdc45df3431d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:04.208146 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c120f-5982-4f54-925c-6ac60b41ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:04.208820 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c120f-5982-4f54-925c-6ac60b41ee06 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:04.209161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c120f-5982-4f54-925c-6ac60b41ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:04.209444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c120f-5982-4f54-925c-6ac60b41ee06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:04.210166 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c120f-5982-4f54-925c-6ac60b41ee06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:04.211763 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c120f-5982-4f54-925c-6ac60b41ee06 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:04.221569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 977/1933] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:04.222821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4334-4789-4952-92e6-b2795f1154a2 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:04.223113 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4334-4789-4952-92e6-b2795f1154a2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:04.223484 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4334-4789-4952-92e6-b2795f1154a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:04.234676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07860fa-0e4f-4b78-ac25-cdc45df3431d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:04.236293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07860fa-0e4f-4b78-ac25-cdc45df3431d service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:04.242407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-509d4334-4789-4952-92e6-b2795f1154a2 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:04.243616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-509d4334-4789-4952-92e6-b2795f1154a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:04.246185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 957/1934] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:04.247042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07860fa-0e4f-4b78-ac25-cdc45df3431d service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:04.248419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c07860fa-0e4f-4b78-ac25-cdc45df3431d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:04.256226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 978/1935] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:04.262701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07860fa-0e4f-4b78-ac25-cdc45df3431d service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:04.264651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d4334-4789-4952-92e6-b2795f1154a2 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:04.266518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-509d4334-4789-4952-92e6-b2795f1154a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:04.269518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4354f23-f13e-4a26-9ab8-696e93ad0332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:04.269518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4354f23-f13e-4a26-9ab8-696e93ad0332 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:04.269518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4354f23-f13e-4a26-9ab8-696e93ad0332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:04.269841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4354f23-f13e-4a26-9ab8-696e93ad0332 admin admin] PATH_INFO: `/v3/projects/f74a2c6814fb44a0a3093584093e4e0c/users/58829cc34e1a4cfdb637b0cc1f36d045/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:04.272074 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4354f23-f13e-4a26-9ab8-696e93ad0332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74a2c6814fb44a0a3093584093e4e0c, user_id=58829cc34e1a4cfdb637b0cc1f36d045, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:04.274848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4354f23-f13e-4a26-9ab8-696e93ad0332 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:04.287895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 958/1936] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:04 2022] PUT /identity/v3/projects/f74a2c6814fb44a0a3093584093e4e0c/users/58829cc34e1a4cfdb637b0cc1f36d045/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:04.298706 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370787ec-4307-4e57-8593-2eca35356579 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:04.298994 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370787ec-4307-4e57-8593-2eca35356579 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:04.299268 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370787ec-4307-4e57-8593-2eca35356579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:04.325682 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-370787ec-4307-4e57-8593-2eca35356579 None None] MFA Rules not processed for user `58829cc34e1a4cfdb637b0cc1f36d045`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:04.326869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-370787ec-4307-4e57-8593-2eca35356579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:04.337316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d4334-4789-4952-92e6-b2795f1154a2 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:04.389144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21438a-e8be-4bec-a355-95eba5e3738c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:04.390330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21438a-e8be-4bec-a355-95eba5e3738c service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:04.390863 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21438a-e8be-4bec-a355-95eba5e3738c service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:04.391166 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21438a-e8be-4bec-a355-95eba5e3738c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:04.401251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 959/1937] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:04.411728 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370787ec-4307-4e57-8593-2eca35356579 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:04.413813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-370787ec-4307-4e57-8593-2eca35356579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:04.459631 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21438a-e8be-4bec-a355-95eba5e3738c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:04.461340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f21438a-e8be-4bec-a355-95eba5e3738c service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:04.478478 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 979/1938] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:04.491612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370787ec-4307-4e57-8593-2eca35356579 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:04.496799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea0721-8fd3-4581-b932-a40e5eafcddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:04.497711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea0721-8fd3-4581-b932-a40e5eafcddf service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:04.498064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea0721-8fd3-4581-b932-a40e5eafcddf service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:04.498412 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea0721-8fd3-4581-b932-a40e5eafcddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:04.509089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea0721-8fd3-4581-b932-a40e5eafcddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:04.510632 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea0721-8fd3-4581-b932-a40e5eafcddf service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:04.522818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 960/1939] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:28:04.804688 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21438a-e8be-4bec-a355-95eba5e3738c service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:04.806452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2f21438a-e8be-4bec-a355-95eba5e3738c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:04.847915 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21438a-e8be-4bec-a355-95eba5e3738c service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:04.876473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:04.877348 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:04.877622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:04.877987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] PATH_INFO: `/v3/projects/adc19d4802d9428cb5239d274508c01b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:04.880547 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc19d4802d9428cb5239d274508c01b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:04.890740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:04.959113 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc19d4802d9428cb5239d274508c01b', 'request_id': 'req-55a31c31-08b6-492f-a987-438e146b867b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:04.966101 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc19d4802d9428cb5239d274508c01b', 'request_id': 'req-55a31c31-08b6-492f-a987-438e146b867b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:04.972932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc19d4802d9428cb5239d274508c01b', 'request_id': 'req-55a31c31-08b6-492f-a987-438e146b867b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:04.989949 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] The token cache is being invalidate because project adc19d4802d9428cb5239d274508c01b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:04.990894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:04.991865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:04.994431 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 980/1940] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:04 2022] DELETE /identity/v3/projects/adc19d4802d9428cb5239d274508c01b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:04.997957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea0721-8fd3-4581-b932-a40e5eafcddf service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:05.019229 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea0721-8fd3-4581-b932-a40e5eafcddf service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:05.024654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:05.027554 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:05.133978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a31c31-08b6-492f-a987-438e146b867b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:05.137400 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:05.137953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408407cd-df13-4747-be2f-a8bac84f6adb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:05.138416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:05.138597 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408407cd-df13-4747-be2f-a8bac84f6adb service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:05.138793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:05.138909 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408407cd-df13-4747-be2f-a8bac84f6adb service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:05.139143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408407cd-df13-4747-be2f-a8bac84f6adb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:05.139253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] PATH_INFO: `/v3/users/abbccec4d533469f8eba025bbadcebb7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:05.140626 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abbccec4d533469f8eba025bbadcebb7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:05.141048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-408407cd-df13-4747-be2f-a8bac84f6adb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:05.143212 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:05.203079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abbccec4d533469f8eba025bbadcebb7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:05.215248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abbccec4d533469f8eba025bbadcebb7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:05.216042 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408407cd-df13-4747-be2f-a8bac84f6adb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:05.217711 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408407cd-df13-4747-be2f-a8bac84f6adb service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:05.224426 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abbccec4d533469f8eba025bbadcebb7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:05.231082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 981/1941] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:05.234940 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abbccec4d533469f8eba025bbadcebb7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:05.235832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abbccec4d533469f8eba025bbadcebb7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:05.243063 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 961/1942] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:04 2022] DELETE /identity/v3/users/abbccec4d533469f8eba025bbadcebb7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:05.309103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408407cd-df13-4747-be2f-a8bac84f6adb service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:05.324980 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408407cd-df13-4747-be2f-a8bac84f6adb service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:05.405213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a340f2-814c-40de-b86c-b5e986b41147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:05.407111 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a340f2-814c-40de-b86c-b5e986b41147 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:05.407693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a340f2-814c-40de-b86c-b5e986b41147 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:05.408195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a340f2-814c-40de-b86c-b5e986b41147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:05.412704 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-39a340f2-814c-40de-b86c-b5e986b41147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:05.491282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a340f2-814c-40de-b86c-b5e986b41147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:05.491696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a340f2-814c-40de-b86c-b5e986b41147 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:05.502413 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 982/1943] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:05.582145 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:05.583803 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:05.686682 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c697272-cc39-41b2-a32a-fdea16a604c2 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:05.694377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46632058-7335-4a51-8310-e033f5f9630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:05.695411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46632058-7335-4a51-8310-e033f5f9630b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:05.695785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46632058-7335-4a51-8310-e033f5f9630b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:05.696154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46632058-7335-4a51-8310-e033f5f9630b admin admin] PATH_INFO: `/v3/projects/a888e9da7e794ecb8237f6621b1675c8` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:05.697579 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46632058-7335-4a51-8310-e033f5f9630b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a888e9da7e794ecb8237f6621b1675c8)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:05.699628 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46632058-7335-4a51-8310-e033f5f9630b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:05.751285 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-46632058-7335-4a51-8310-e033f5f9630b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a888e9da7e794ecb8237f6621b1675c8', 'request_id': 'req-46632058-7335-4a51-8310-e033f5f9630b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:05.760094 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-46632058-7335-4a51-8310-e033f5f9630b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a888e9da7e794ecb8237f6621b1675c8', 'request_id': 'req-46632058-7335-4a51-8310-e033f5f9630b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:05.767516 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-46632058-7335-4a51-8310-e033f5f9630b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a888e9da7e794ecb8237f6621b1675c8', 'request_id': 'req-46632058-7335-4a51-8310-e033f5f9630b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:05.782252 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-46632058-7335-4a51-8310-e033f5f9630b admin admin] The token cache is being invalidate because project a888e9da7e794ecb8237f6621b1675c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:05.782523 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-46632058-7335-4a51-8310-e033f5f9630b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:05.783182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-46632058-7335-4a51-8310-e033f5f9630b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:05.784963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 962/1944] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:05 2022] DELETE /identity/v3/projects/a888e9da7e794ecb8237f6621b1675c8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:05.789727 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a650bd-84fd-48b6-960f-564d2b936a30 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:05.790015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a650bd-84fd-48b6-960f-564d2b936a30 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:05.790297 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a650bd-84fd-48b6-960f-564d2b936a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:05.819859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-38a650bd-84fd-48b6-960f-564d2b936a30 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:05.821248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-38a650bd-84fd-48b6-960f-564d2b936a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:05.929349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 983/1945] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:05.930950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed1af3-9b05-42c2-b0e7-c41f9753161a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:05.931315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed1af3-9b05-42c2-b0e7-c41f9753161a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:05.931634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed1af3-9b05-42c2-b0e7-c41f9753161a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:05.956144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-38ed1af3-9b05-42c2-b0e7-c41f9753161a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:05.957363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-38ed1af3-9b05-42c2-b0e7-c41f9753161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:05.965477 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 963/1946] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:05.970624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a650bd-84fd-48b6-960f-564d2b936a30 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:05.981174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a650bd-84fd-48b6-960f-564d2b936a30 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:05.985965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902225-bf11-4e34-8d34-ecf7547618cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:05.986622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902225-bf11-4e34-8d34-ecf7547618cc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:05.986906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902225-bf11-4e34-8d34-ecf7547618cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:05.987180 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e902225-bf11-4e34-8d34-ecf7547618cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:05.987937 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e902225-bf11-4e34-8d34-ecf7547618cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:05.988275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e902225-bf11-4e34-8d34-ecf7547618cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:05.989901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e902225-bf11-4e34-8d34-ecf7547618cc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:06.002464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 984/1947] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:28:06.006714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed1af3-9b05-42c2-b0e7-c41f9753161a None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:06.018614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed1af3-9b05-42c2-b0e7-c41f9753161a None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:06.025257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d285f-bb5f-4283-b7bb-2d81b6b1eb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:06.026847 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d285f-bb5f-4283-b7bb-2d81b6b1eb75 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:06.027189 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d285f-bb5f-4283-b7bb-2d81b6b1eb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:06.027775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d285f-bb5f-4283-b7bb-2d81b6b1eb75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:06.028583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d285f-bb5f-4283-b7bb-2d81b6b1eb75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:06.031252 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d285f-bb5f-4283-b7bb-2d81b6b1eb75 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:06.064615 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 964/1948] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:06 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:06.066050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902225-bf11-4e34-8d34-ecf7547618cc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:06.075781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e902225-bf11-4e34-8d34-ecf7547618cc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:06.134874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95d33c-f130-4089-b004-028caa103432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:06.135549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d33c-f130-4089-b004-028caa103432 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:06.135838 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d33c-f130-4089-b004-028caa103432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:06.136149 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d33c-f130-4089-b004-028caa103432 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:06.136866 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95d33c-f130-4089-b004-028caa103432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:06.138769 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95d33c-f130-4089-b004-028caa103432 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:06.161668 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 985/1949] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:06 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:06.165738 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d285f-bb5f-4283-b7bb-2d81b6b1eb75 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:06.178020 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d285f-bb5f-4283-b7bb-2d81b6b1eb75 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:06.182741 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf746008-9aca-4425-8ced-acc22f60c1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:06.183458 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf746008-9aca-4425-8ced-acc22f60c1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:06.183738 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf746008-9aca-4425-8ced-acc22f60c1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:06.184014 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf746008-9aca-4425-8ced-acc22f60c1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:06.184759 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf746008-9aca-4425-8ced-acc22f60c1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:06.186581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf746008-9aca-4425-8ced-acc22f60c1b5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:06.201264 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 965/1950] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:06.203380 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95d33c-f130-4089-b004-028caa103432 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:06.214970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95d33c-f130-4089-b004-028caa103432 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:06.220949 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a5321-8296-4de2-8187-12c94a682028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:06.221620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a5321-8296-4de2-8187-12c94a682028 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:06.221901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a5321-8296-4de2-8187-12c94a682028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:06.222177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a5321-8296-4de2-8187-12c94a682028 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:06.222912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a5321-8296-4de2-8187-12c94a682028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:06.224543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a5321-8296-4de2-8187-12c94a682028 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:06.235641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 986/1951] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:06.239882 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf746008-9aca-4425-8ced-acc22f60c1b5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:06.251472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf746008-9aca-4425-8ced-acc22f60c1b5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:06.256317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e568d31-2d99-46da-bcfc-0e12d0640a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:06.257216 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e568d31-2d99-46da-bcfc-0e12d0640a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:06.257501 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e568d31-2d99-46da-bcfc-0e12d0640a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:06.257777 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e568d31-2d99-46da-bcfc-0e12d0640a19 admin admin] PATH_INFO: `/v3/projects/ef61f74c67e54c3b8072bf64255fa453/users/dc402ff5d1e045eb83221298a8f76b55/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:06.273914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e568d31-2d99-46da-bcfc-0e12d0640a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef61f74c67e54c3b8072bf64255fa453, user_id=dc402ff5d1e045eb83221298a8f76b55, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:06.277149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e568d31-2d99-46da-bcfc-0e12d0640a19 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:06.291204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 966/1952] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:06 2022] PUT /identity/v3/projects/ef61f74c67e54c3b8072bf64255fa453/users/dc402ff5d1e045eb83221298a8f76b55/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:06.301896 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1d8d5-3691-4af6-8b76-b7170c4a86d4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:06.302186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1d8d5-3691-4af6-8b76-b7170c4a86d4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:06.302467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1d8d5-3691-4af6-8b76-b7170c4a86d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:06.333810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-99b1d8d5-3691-4af6-8b76-b7170c4a86d4 None None] MFA Rules not processed for user `dc402ff5d1e045eb83221298a8f76b55`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:06.335036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-99b1d8d5-3691-4af6-8b76-b7170c4a86d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:06.404925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 987/1953] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:06.605008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e568d31-2d99-46da-bcfc-0e12d0640a19 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:06.615963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9e568d31-2d99-46da-bcfc-0e12d0640a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:06.700890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e568d31-2d99-46da-bcfc-0e12d0640a19 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:06.708727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87920337-7037-4bbe-a7cf-4097765c6029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:06.709392 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87920337-7037-4bbe-a7cf-4097765c6029 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:06.709676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87920337-7037-4bbe-a7cf-4097765c6029 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:06.709955 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87920337-7037-4bbe-a7cf-4097765c6029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:06.720976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87920337-7037-4bbe-a7cf-4097765c6029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:06.722510 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87920337-7037-4bbe-a7cf-4097765c6029 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:06.732555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 967/1954] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:28:07.470427 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1d8d5-3691-4af6-8b76-b7170c4a86d4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:07.474034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-99b1d8d5-3691-4af6-8b76-b7170c4a86d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:07.548230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1d8d5-3691-4af6-8b76-b7170c4a86d4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:07.556779 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:07.557864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:07.558136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:07.558411 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] PATH_INFO: `/v3/users/6453d470db164809a3168d4d6632e5da` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:07.559635 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6453d470db164809a3168d4d6632e5da)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:07.561590 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:07.618382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6453d470db164809a3168d4d6632e5da'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:07.633986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6453d470db164809a3168d4d6632e5da'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:07.635642 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6453d470db164809a3168d4d6632e5da'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:07.643192 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6453d470db164809a3168d4d6632e5da'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:07.650469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6453d470db164809a3168d4d6632e5da'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:07.659263 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 988/1955] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:07 2022] DELETE /identity/v3/users/6453d470db164809a3168d4d6632e5da => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:07.664551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67076c3-dd7d-4924-bc59-53a3873ff36c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:07.665225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67076c3-dd7d-4924-bc59-53a3873ff36c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:07.665225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67076c3-dd7d-4924-bc59-53a3873ff36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:07.685164 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-d67076c3-dd7d-4924-bc59-53a3873ff36c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:07.686425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d67076c3-dd7d-4924-bc59-53a3873ff36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:07.770537 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 968/1956] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:07.782754 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:07.784149 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:07.895279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00746b72-9f10-4ccb-a801-16a7c96b1311 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:07.916202 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0fa39-8241-4fd4-aa12-f1b3e3a90dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:07.917221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0fa39-8241-4fd4-aa12-f1b3e3a90dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:07.917435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0fa39-8241-4fd4-aa12-f1b3e3a90dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:07.917996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0fa39-8241-4fd4-aa12-f1b3e3a90dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:07.930592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0fa39-8241-4fd4-aa12-f1b3e3a90dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:07.932276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0fa39-8241-4fd4-aa12-f1b3e3a90dc7 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:07.953049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 989/1957] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:28:08.321702 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67076c3-dd7d-4924-bc59-53a3873ff36c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:08.323148 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d67076c3-dd7d-4924-bc59-53a3873ff36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:08.338514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67076c3-dd7d-4924-bc59-53a3873ff36c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:08.351440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:08.352741 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:08.359367 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:08.359748 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] PATH_INFO: `/v3/projects/0075f351f48548d3825104e3bf1fe7af` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:08.362706 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0075f351f48548d3825104e3bf1fe7af)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:08.364721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:08.445512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0075f351f48548d3825104e3bf1fe7af', 'request_id': 'req-0a48fc4f-66b2-45c8-adf3-d14c4175e957'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:08.455632 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0075f351f48548d3825104e3bf1fe7af', 'request_id': 'req-0a48fc4f-66b2-45c8-adf3-d14c4175e957'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:08.468488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0075f351f48548d3825104e3bf1fe7af', 'request_id': 'req-0a48fc4f-66b2-45c8-adf3-d14c4175e957'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:08.487372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] The token cache is being invalidate because project 0075f351f48548d3825104e3bf1fe7af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:08.487947 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:08.489047 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:08.493615 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 969/1958] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:08 2022] DELETE /identity/v3/projects/0075f351f48548d3825104e3bf1fe7af => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:08.498379 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0fa39-8241-4fd4-aa12-f1b3e3a90dc7 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:08.522053 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0fa39-8241-4fd4-aa12-f1b3e3a90dc7 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:08.629929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfe367-0313-4d13-8198-e337c0e9905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:08.631924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfe367-0313-4d13-8198-e337c0e9905f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:08.632758 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfe367-0313-4d13-8198-e337c0e9905f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:08.633249 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfe367-0313-4d13-8198-e337c0e9905f admin admin] PATH_INFO: `/v3/users/f1c844cd155a47689697f9b1e657f22f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:08.635575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfe367-0313-4d13-8198-e337c0e9905f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c844cd155a47689697f9b1e657f22f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:08.638432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfe367-0313-4d13-8198-e337c0e9905f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:08.716332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5ecfe367-0313-4d13-8198-e337c0e9905f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c844cd155a47689697f9b1e657f22f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:08.737082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5ecfe367-0313-4d13-8198-e337c0e9905f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c844cd155a47689697f9b1e657f22f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:08.738309 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5ecfe367-0313-4d13-8198-e337c0e9905f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c844cd155a47689697f9b1e657f22f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:08.750919 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5ecfe367-0313-4d13-8198-e337c0e9905f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c844cd155a47689697f9b1e657f22f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:08.758803 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5ecfe367-0313-4d13-8198-e337c0e9905f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c844cd155a47689697f9b1e657f22f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:08.766019 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 990/1959] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:08 2022] DELETE /identity/v3/users/f1c844cd155a47689697f9b1e657f22f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:09.031607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:09.033127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:09.048292 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48fc4f-66b2-45c8-adf3-d14c4175e957 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:09.105980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:09.106834 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.107119 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.107398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] PATH_INFO: `/v3/projects/1b96a3bd13de41ba8600a58308e7193c` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.109206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b96a3bd13de41ba8600a58308e7193c)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:09.111195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:09.157698 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b96a3bd13de41ba8600a58308e7193c', 'request_id': 'req-402c1172-d438-41f2-b8bd-188a02981350'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:09.162924 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b96a3bd13de41ba8600a58308e7193c', 'request_id': 'req-402c1172-d438-41f2-b8bd-188a02981350'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:09.168858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b96a3bd13de41ba8600a58308e7193c', 'request_id': 'req-402c1172-d438-41f2-b8bd-188a02981350'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:09.181310 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] The token cache is being invalidate because project 1b96a3bd13de41ba8600a58308e7193c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:09.181615 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:09.182228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:09.183740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 970/1960] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:09 2022] DELETE /identity/v3/projects/1b96a3bd13de41ba8600a58308e7193c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:09.189573 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9dc0-f94f-41c6-841a-41761da7f2e4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.189859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9dc0-f94f-41c6-841a-41761da7f2e4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.190129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca9dc0-f94f-41c6-841a-41761da7f2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.207541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-61ca9dc0-f94f-41c6-841a-41761da7f2e4 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:09.208849 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-61ca9dc0-f94f-41c6-841a-41761da7f2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:09.254946 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:09.256402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:09.268621 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 991/1961] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:09.277460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739a42d-5d40-4cbf-95a8-399164c78e49 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.277742 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739a42d-5d40-4cbf-95a8-399164c78e49 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.278018 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739a42d-5d40-4cbf-95a8-399164c78e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.303182 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f739a42d-5d40-4cbf-95a8-399164c78e49 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:09.304931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f739a42d-5d40-4cbf-95a8-399164c78e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:09.316157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 992/1962] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:09.320480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739a42d-5d40-4cbf-95a8-399164c78e49 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:09.330465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c1172-d438-41f2-b8bd-188a02981350 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:09.332138 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739a42d-5d40-4cbf-95a8-399164c78e49 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:09.335512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d4c42-fef0-478d-b720-2eb77f8ec15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:09.336510 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d4c42-fef0-478d-b720-2eb77f8ec15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.336790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d4c42-fef0-478d-b720-2eb77f8ec15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.336915 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a1788-4775-4fd4-9d34-d8911874e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:09.337075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d4c42-fef0-478d-b720-2eb77f8ec15f admin admin] PATH_INFO: `/v3/users/80447dcb5d224e4fb084d41c39d1049e` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.337562 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a1788-4775-4fd4-9d34-d8911874e899 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.337844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a1788-4775-4fd4-9d34-d8911874e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.338116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a1788-4775-4fd4-9d34-d8911874e899 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.338237 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d4c42-fef0-478d-b720-2eb77f8ec15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=80447dcb5d224e4fb084d41c39d1049e)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:09.338829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a1788-4775-4fd4-9d34-d8911874e899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:09.339340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a1788-4775-4fd4-9d34-d8911874e899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:09.340212 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d4c42-fef0-478d-b720-2eb77f8ec15f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:09.342002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a1788-4775-4fd4-9d34-d8911874e899 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:09.359450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 993/1963] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:28:09.360452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a1788-4775-4fd4-9d34-d8911874e899 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:09.370009 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a1788-4775-4fd4-9d34-d8911874e899 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:09.375398 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed820fb-1e20-4ae9-b624-591c66d375e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:09.376047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed820fb-1e20-4ae9-b624-591c66d375e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.376346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed820fb-1e20-4ae9-b624-591c66d375e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.376619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed820fb-1e20-4ae9-b624-591c66d375e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.377336 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed820fb-1e20-4ae9-b624-591c66d375e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:09.379259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed820fb-1e20-4ae9-b624-591c66d375e8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:09.386486 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-248d4c42-fef0-478d-b720-2eb77f8ec15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80447dcb5d224e4fb084d41c39d1049e'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:09.398554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-248d4c42-fef0-478d-b720-2eb77f8ec15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80447dcb5d224e4fb084d41c39d1049e'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:09.408889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 994/1964] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:09 2022] POST /identity/v3/projects => generated 407 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:09.409044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-248d4c42-fef0-478d-b720-2eb77f8ec15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80447dcb5d224e4fb084d41c39d1049e'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:09.410150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed820fb-1e20-4ae9-b624-591c66d375e8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:09.414869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-248d4c42-fef0-478d-b720-2eb77f8ec15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80447dcb5d224e4fb084d41c39d1049e'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:09.415776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-248d4c42-fef0-478d-b720-2eb77f8ec15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80447dcb5d224e4fb084d41c39d1049e'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:09.422987 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 971/1965] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:09 2022] DELETE /identity/v3/users/80447dcb5d224e4fb084d41c39d1049e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:09.427330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d3270-b15d-4316-982e-d26a577b3755 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.427682 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d3270-b15d-4316-982e-d26a577b3755 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.427963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d3270-b15d-4316-982e-d26a577b3755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.445614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-812d3270-b15d-4316-982e-d26a577b3755 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:09.446789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-812d3270-b15d-4316-982e-d26a577b3755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:09.477522 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed820fb-1e20-4ae9-b624-591c66d375e8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:09.507246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 972/1966] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:09.517801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d3270-b15d-4316-982e-d26a577b3755 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:09.519610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-812d3270-b15d-4316-982e-d26a577b3755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:09.534698 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163bdd-162d-4c50-916f-dd8bfd7c72b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:09.535371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163bdd-162d-4c50-916f-dd8bfd7c72b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.535652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163bdd-162d-4c50-916f-dd8bfd7c72b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.535978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163bdd-162d-4c50-916f-dd8bfd7c72b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.536635 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9163bdd-162d-4c50-916f-dd8bfd7c72b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:09.538545 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9163bdd-162d-4c50-916f-dd8bfd7c72b1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:09.560116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 995/1967] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:09 2022] POST /identity/v3/users => generated 304 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:09.564276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163bdd-162d-4c50-916f-dd8bfd7c72b1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:09.566206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b9163bdd-162d-4c50-916f-dd8bfd7c72b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:09.579268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163bdd-162d-4c50-916f-dd8bfd7c72b1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:09.582039 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d3270-b15d-4316-982e-d26a577b3755 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:09.585941 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e155b-62e3-447f-acd9-b1b797613f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:09.586651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e155b-62e3-447f-acd9-b1b797613f17 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.586934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e155b-62e3-447f-acd9-b1b797613f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.587217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e155b-62e3-447f-acd9-b1b797613f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.587947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e155b-62e3-447f-acd9-b1b797613f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:09.590170 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e155b-62e3-447f-acd9-b1b797613f17 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:09.596886 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf19655-36a8-44a8-83ae-921c356006fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:09.598306 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf19655-36a8-44a8-83ae-921c356006fc service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.598826 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf19655-36a8-44a8-83ae-921c356006fc service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.599779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf19655-36a8-44a8-83ae-921c356006fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.600745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 996/1968] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:28:09.605025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e155b-62e3-447f-acd9-b1b797613f17 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:09.613361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf19655-36a8-44a8-83ae-921c356006fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:09.616671 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf19655-36a8-44a8-83ae-921c356006fc service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:09.621008 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e155b-62e3-447f-acd9-b1b797613f17 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:09.627203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad487d71-85d5-4a72-a771-186395f292c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:09.627943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad487d71-85d5-4a72-a771-186395f292c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.628314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad487d71-85d5-4a72-a771-186395f292c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.628648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad487d71-85d5-4a72-a771-186395f292c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.629435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad487d71-85d5-4a72-a771-186395f292c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:09.629819 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 973/1969] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:28:09.633658 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad487d71-85d5-4a72-a771-186395f292c2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:09.647746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 997/1970] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:09.649102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf19655-36a8-44a8-83ae-921c356006fc service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:09.659446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf19655-36a8-44a8-83ae-921c356006fc service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:09.664191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd81a8-9ca7-43ad-bf35-6a0a10e445f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:09.665150 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd81a8-9ca7-43ad-bf35-6a0a10e445f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.665458 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd81a8-9ca7-43ad-bf35-6a0a10e445f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.665849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd81a8-9ca7-43ad-bf35-6a0a10e445f0 admin admin] PATH_INFO: `/v3/projects/20b0954db48a4eb5a0928c9ffddb3aeb/users/9f8274b5f64a4cf3ab7e1a5871f06127/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.681798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd81a8-9ca7-43ad-bf35-6a0a10e445f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b0954db48a4eb5a0928c9ffddb3aeb, user_id=9f8274b5f64a4cf3ab7e1a5871f06127, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:09.684641 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd81a8-9ca7-43ad-bf35-6a0a10e445f0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:09.701878 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 974/1971] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:09 2022] PUT /identity/v3/projects/20b0954db48a4eb5a0928c9ffddb3aeb/users/9f8274b5f64a4cf3ab7e1a5871f06127/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:09.713275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae1ff5-edcd-4309-adb9-44b012d393d8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.713672 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae1ff5-edcd-4309-adb9-44b012d393d8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.714082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae1ff5-edcd-4309-adb9-44b012d393d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.746768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-95ae1ff5-edcd-4309-adb9-44b012d393d8 None None] MFA Rules not processed for user `9f8274b5f64a4cf3ab7e1a5871f06127`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:09.748292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-95ae1ff5-edcd-4309-adb9-44b012d393d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:09.819879 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 998/1972] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:09.824216 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd81a8-9ca7-43ad-bf35-6a0a10e445f0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:09.888630 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd81a8-9ca7-43ad-bf35-6a0a10e445f0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:09.894270 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d48236-e8d1-4039-8e39-700e1c695302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:09.895032 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d48236-e8d1-4039-8e39-700e1c695302 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.895386 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d48236-e8d1-4039-8e39-700e1c695302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.895730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d48236-e8d1-4039-8e39-700e1c695302 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.896541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d48236-e8d1-4039-8e39-700e1c695302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:09.898508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d48236-e8d1-4039-8e39-700e1c695302 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:09.927773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 975/1973] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:09 2022] POST /identity/v3/projects => generated 407 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:09.929520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae1ff5-edcd-4309-adb9-44b012d393d8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:09.940016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae1ff5-edcd-4309-adb9-44b012d393d8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:09.995318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf3622-0565-4008-bf78-14540c5f9f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:09.996008 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf3622-0565-4008-bf78-14540c5f9f5a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:09.996392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf3622-0565-4008-bf78-14540c5f9f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:09.996673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf3622-0565-4008-bf78-14540c5f9f5a admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:09.997498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf3622-0565-4008-bf78-14540c5f9f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:09.999968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf3622-0565-4008-bf78-14540c5f9f5a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:10.028472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 999/1974] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:09 2022] POST /identity/v3/users => generated 310 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:10.033658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d48236-e8d1-4039-8e39-700e1c695302 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:10.048713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d48236-e8d1-4039-8e39-700e1c695302 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:10.053887 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39df99-b2cf-4db6-8880-44f0bd2c86fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:10.054555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39df99-b2cf-4db6-8880-44f0bd2c86fa admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:10.055031 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39df99-b2cf-4db6-8880-44f0bd2c86fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:10.055387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39df99-b2cf-4db6-8880-44f0bd2c86fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:10.056282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39df99-b2cf-4db6-8880-44f0bd2c86fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:10.058074 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39df99-b2cf-4db6-8880-44f0bd2c86fa admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:10.070852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 976/1975] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:10.074099 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf3622-0565-4008-bf78-14540c5f9f5a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:10.075885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a9cf3622-0565-4008-bf78-14540c5f9f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:10.084952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39df99-b2cf-4db6-8880-44f0bd2c86fa admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:10.089849 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf3622-0565-4008-bf78-14540c5f9f5a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:10.096724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:10.097586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:10.097874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:10.098151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] PATH_INFO: `/v3/projects/6e17c61d3244485394d215766e3bee74` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:10.098711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39df99-b2cf-4db6-8880-44f0bd2c86fa admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:10.099356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e17c61d3244485394d215766e3bee74)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:10.101324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:10.105056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931db502-20b6-49b6-80f1-b93ee38e36c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:10.105939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db502-20b6-49b6-80f1-b93ee38e36c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:10.106248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db502-20b6-49b6-80f1-b93ee38e36c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:10.106512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db502-20b6-49b6-80f1-b93ee38e36c7 admin admin] PATH_INFO: `/v3/projects/93165e235c0148e9b4825d8804f555a6/users/bd438d2731fa47d0bedce8e35bb8fc1b/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:10.121653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931db502-20b6-49b6-80f1-b93ee38e36c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93165e235c0148e9b4825d8804f555a6, user_id=bd438d2731fa47d0bedce8e35bb8fc1b, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:10.124404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931db502-20b6-49b6-80f1-b93ee38e36c7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:10.138022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 977/1976] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:10 2022] PUT /identity/v3/projects/93165e235c0148e9b4825d8804f555a6/users/bd438d2731fa47d0bedce8e35bb8fc1b/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:10.142118 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931db502-20b6-49b6-80f1-b93ee38e36c7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:10.148001 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e17c61d3244485394d215766e3bee74', 'request_id': 'req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.153536 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e17c61d3244485394d215766e3bee74', 'request_id': 'req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.160681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e17c61d3244485394d215766e3bee74', 'request_id': 'req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.175689 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] The token cache is being invalidate because project 6e17c61d3244485394d215766e3bee74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:10.176263 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.177050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.179312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1000/1977] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:10 2022] DELETE /identity/v3/projects/6e17c61d3244485394d215766e3bee74 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:10.183032 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:10.184453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:10.206233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931db502-20b6-49b6-80f1-b93ee38e36c7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:10.248795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3e2f8-031d-458b-ad92-3b7748ae20a6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:10.253906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:10.254776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:10.255057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:10.255330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] PATH_INFO: `/v3/users/d9f79700dd2f4574a932a81b5bc2c967` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:10.256555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f79700dd2f4574a932a81b5bc2c967)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:10.258478 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:10.260335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ebf4c-c08b-4464-83a2-b971a0e06fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:10.261078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ebf4c-c08b-4464-83a2-b971a0e06fba admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:10.261433 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ebf4c-c08b-4464-83a2-b971a0e06fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:10.261776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ebf4c-c08b-4464-83a2-b971a0e06fba admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:10.262563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ebf4c-c08b-4464-83a2-b971a0e06fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:10.264239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ebf4c-c08b-4464-83a2-b971a0e06fba admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:10.278294 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 978/1978] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:28:10.279292 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ebf4c-c08b-4464-83a2-b971a0e06fba admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:10.282210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-545ebf4c-c08b-4464-83a2-b971a0e06fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:10.294847 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ebf4c-c08b-4464-83a2-b971a0e06fba admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:10.299900 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71334f3e-fff1-4be0-80af-182facc86859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:10.300756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71334f3e-fff1-4be0-80af-182facc86859 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:10.301044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71334f3e-fff1-4be0-80af-182facc86859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:10.301325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71334f3e-fff1-4be0-80af-182facc86859 admin admin] PATH_INFO: `/v3/projects/93165e235c0148e9b4825d8804f555a6/users/bd438d2731fa47d0bedce8e35bb8fc1b/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:10.303277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71334f3e-fff1-4be0-80af-182facc86859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93165e235c0148e9b4825d8804f555a6, user_id=bd438d2731fa47d0bedce8e35bb8fc1b, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:10.303792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f79700dd2f4574a932a81b5bc2c967'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.305948 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71334f3e-fff1-4be0-80af-182facc86859 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:10.316013 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f79700dd2f4574a932a81b5bc2c967'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.316393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 979/1979] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:10 2022] PUT /identity/v3/projects/93165e235c0148e9b4825d8804f555a6/users/bd438d2731fa47d0bedce8e35bb8fc1b/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:10.316883 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f79700dd2f4574a932a81b5bc2c967'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.328471 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f79700dd2f4574a932a81b5bc2c967'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.329039 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400934-9b9c-45e7-81d5-a0307c220362 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:10.329332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400934-9b9c-45e7-81d5-a0307c220362 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:10.329616 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400934-9b9c-45e7-81d5-a0307c220362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:10.335500 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f79700dd2f4574a932a81b5bc2c967'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.346119 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1001/1980] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:10 2022] DELETE /identity/v3/users/d9f79700dd2f4574a932a81b5bc2c967 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:10.360579 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-4b400934-9b9c-45e7-81d5-a0307c220362 None None] MFA Rules not processed for user `bd438d2731fa47d0bedce8e35bb8fc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:10.361791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4b400934-9b9c-45e7-81d5-a0307c220362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:10.436144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 980/1981] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:10 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:10.447124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:10.448717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:10.509671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de5424-553f-478e-a345-fe44f212eab1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:10.513383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca9b3-99cc-4f5f-bfb4-b8a8eebd0e4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:10.514056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca9b3-99cc-4f5f-bfb4-b8a8eebd0e4c service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:10.514486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca9b3-99cc-4f5f-bfb4-b8a8eebd0e4c service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:10.515446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fca9b3-99cc-4f5f-bfb4-b8a8eebd0e4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:10.525049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fca9b3-99cc-4f5f-bfb4-b8a8eebd0e4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:10.526830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fca9b3-99cc-4f5f-bfb4-b8a8eebd0e4c service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:10.537392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1002/1982] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:10 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:10.621914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b400934-9b9c-45e7-81d5-a0307c220362 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:10.623867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4b400934-9b9c-45e7-81d5-a0307c220362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:10.701159 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b400934-9b9c-45e7-81d5-a0307c220362 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:10.706739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:10.707611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:10.707858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:10.708173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] PATH_INFO: `/v3/projects/6910203e6bdc492a98f80ac6948c22d0` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:10.713047 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6910203e6bdc492a98f80ac6948c22d0)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:10.715181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:10.716931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca9b3-99cc-4f5f-bfb4-b8a8eebd0e4c service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:10.725809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fca9b3-99cc-4f5f-bfb4-b8a8eebd0e4c service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:10.729553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b62a38-925c-4ece-ae40-3caa37559ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:10.730191 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b62a38-925c-4ece-ae40-3caa37559ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:10.730473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b62a38-925c-4ece-ae40-3caa37559ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:10.731495 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b62a38-925c-4ece-ae40-3caa37559ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:10.736233 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-81b62a38-925c-4ece-ae40-3caa37559ca9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:10.773770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6910203e6bdc492a98f80ac6948c22d0', 'request_id': 'req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.779712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6910203e6bdc492a98f80ac6948c22d0', 'request_id': 'req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.786187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6910203e6bdc492a98f80ac6948c22d0', 'request_id': 'req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.800206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] The token cache is being invalidate because project 6910203e6bdc492a98f80ac6948c22d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:10.800589 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.801445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.803023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 981/1983] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:10 2022] DELETE /identity/v3/projects/6910203e6bdc492a98f80ac6948c22d0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:10.804335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b62a38-925c-4ece-ae40-3caa37559ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:10.805798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b62a38-925c-4ece-ae40-3caa37559ca9 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:10.806940 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:10.808486 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:10.818277 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1003/1984] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:10 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:10.878217 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3ad23-fcef-40b2-899c-1a45d2bc9900 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:10.882912 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6e1a5-723d-44fa-a2c6-5d1ac07e1ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:10.883775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6e1a5-723d-44fa-a2c6-5d1ac07e1ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:10.884089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6e1a5-723d-44fa-a2c6-5d1ac07e1ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:10.884418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6e1a5-723d-44fa-a2c6-5d1ac07e1ea0 admin admin] PATH_INFO: `/v3/users/43a5d823041a40f5ae3d8e7151adb0a4` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:10.885550 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6e1a5-723d-44fa-a2c6-5d1ac07e1ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a5d823041a40f5ae3d8e7151adb0a4)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:10.887467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6e1a5-723d-44fa-a2c6-5d1ac07e1ea0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:10.933282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b4d6e1a5-723d-44fa-a2c6-5d1ac07e1ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a5d823041a40f5ae3d8e7151adb0a4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.946103 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b4d6e1a5-723d-44fa-a2c6-5d1ac07e1ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a5d823041a40f5ae3d8e7151adb0a4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.953755 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b4d6e1a5-723d-44fa-a2c6-5d1ac07e1ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a5d823041a40f5ae3d8e7151adb0a4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.960743 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b4d6e1a5-723d-44fa-a2c6-5d1ac07e1ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a5d823041a40f5ae3d8e7151adb0a4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.961530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b4d6e1a5-723d-44fa-a2c6-5d1ac07e1ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a5d823041a40f5ae3d8e7151adb0a4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:10.969226 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 982/1985] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:10 2022] DELETE /identity/v3/users/43a5d823041a40f5ae3d8e7151adb0a4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:11.365852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b62a38-925c-4ece-ae40-3caa37559ca9 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:11.377699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b62a38-925c-4ece-ae40-3caa37559ca9 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:11.439306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82187a8f-8ce4-455e-a25a-c671e0ff5400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:11.440208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82187a8f-8ce4-455e-a25a-c671e0ff5400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:11.440493 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82187a8f-8ce4-455e-a25a-c671e0ff5400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:11.440782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82187a8f-8ce4-455e-a25a-c671e0ff5400 admin admin] PATH_INFO: `/v3/projects/d9d8877975bf4e34b19b554f547d7548` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:11.441978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82187a8f-8ce4-455e-a25a-c671e0ff5400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d8877975bf4e34b19b554f547d7548)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:11.443863 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82187a8f-8ce4-455e-a25a-c671e0ff5400 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:11.488566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-82187a8f-8ce4-455e-a25a-c671e0ff5400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d8877975bf4e34b19b554f547d7548', 'request_id': 'req-82187a8f-8ce4-455e-a25a-c671e0ff5400'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:11.493717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-82187a8f-8ce4-455e-a25a-c671e0ff5400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d8877975bf4e34b19b554f547d7548', 'request_id': 'req-82187a8f-8ce4-455e-a25a-c671e0ff5400'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:11.499703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-82187a8f-8ce4-455e-a25a-c671e0ff5400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d8877975bf4e34b19b554f547d7548', 'request_id': 'req-82187a8f-8ce4-455e-a25a-c671e0ff5400'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:11.511157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-82187a8f-8ce4-455e-a25a-c671e0ff5400 admin admin] The token cache is being invalidate because project d9d8877975bf4e34b19b554f547d7548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:11.511444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-82187a8f-8ce4-455e-a25a-c671e0ff5400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:11.512148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-82187a8f-8ce4-455e-a25a-c671e0ff5400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:11.513681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1004/1986] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:11 2022] DELETE /identity/v3/projects/d9d8877975bf4e34b19b554f547d7548 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:11.518801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c0f86-3f60-4443-839e-e536e34522b9 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:11.519280 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c0f86-3f60-4443-839e-e536e34522b9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:11.519381 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c0f86-3f60-4443-839e-e536e34522b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:11.538173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-917c0f86-3f60-4443-839e-e536e34522b9 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:11.539355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-917c0f86-3f60-4443-839e-e536e34522b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:11.596191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 983/1987] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:11.603876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bfbd6-5df7-481c-b97d-736de899c3fb None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:11.604406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bfbd6-5df7-481c-b97d-736de899c3fb None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:11.604499 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bfbd6-5df7-481c-b97d-736de899c3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:11.623014 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4d7bfbd6-5df7-481c-b97d-736de899c3fb None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:11.624329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4d7bfbd6-5df7-481c-b97d-736de899c3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:11.632124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1005/1988] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:11.636176 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c0f86-3f60-4443-839e-e536e34522b9 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:11.646733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c0f86-3f60-4443-839e-e536e34522b9 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:11.651592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be42c-e7ff-4874-9cbc-06100d9d5d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:11.652273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be42c-e7ff-4874-9cbc-06100d9d5d56 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:11.652586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be42c-e7ff-4874-9cbc-06100d9d5d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:11.653054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be42c-e7ff-4874-9cbc-06100d9d5d56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:11.653527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7be42c-e7ff-4874-9cbc-06100d9d5d56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:11.653831 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7be42c-e7ff-4874-9cbc-06100d9d5d56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:11.655950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7be42c-e7ff-4874-9cbc-06100d9d5d56 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:11.667584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 984/1989] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:28:11.672922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bfbd6-5df7-481c-b97d-736de899c3fb None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:11.681803 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bfbd6-5df7-481c-b97d-736de899c3fb None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:11.686468 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb9d49-cffc-40b5-85b9-55b4954df819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:11.687510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb9d49-cffc-40b5-85b9-55b4954df819 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:11.687793 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb9d49-cffc-40b5-85b9-55b4954df819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:11.688098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb9d49-cffc-40b5-85b9-55b4954df819 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:11.688799 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb9d49-cffc-40b5-85b9-55b4954df819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:11.690681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb9d49-cffc-40b5-85b9-55b4954df819 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:11.717533 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1006/1990] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:11 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:11.722909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be42c-e7ff-4874-9cbc-06100d9d5d56 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:11.732675 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be42c-e7ff-4874-9cbc-06100d9d5d56 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:11.788890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d6f04-464b-4a88-965a-99ae388a0130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:11.789556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6f04-464b-4a88-965a-99ae388a0130 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:11.789837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6f04-464b-4a88-965a-99ae388a0130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:11.790112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6f04-464b-4a88-965a-99ae388a0130 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:11.790798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d6f04-464b-4a88-965a-99ae388a0130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:11.792745 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d6f04-464b-4a88-965a-99ae388a0130 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:11.812223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 985/1991] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:11 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:11.816210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb9d49-cffc-40b5-85b9-55b4954df819 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:11.826711 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb9d49-cffc-40b5-85b9-55b4954df819 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:11.832570 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1be72-ff64-454e-9dc9-7800b46b1661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:11.833231 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1be72-ff64-454e-9dc9-7800b46b1661 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:11.833513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1be72-ff64-454e-9dc9-7800b46b1661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:11.833787 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1be72-ff64-454e-9dc9-7800b46b1661 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:11.834680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1be72-ff64-454e-9dc9-7800b46b1661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:11.836307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1be72-ff64-454e-9dc9-7800b46b1661 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:11.847850 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1007/1992] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:11.852268 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d6f04-464b-4a88-965a-99ae388a0130 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:11.862440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d6f04-464b-4a88-965a-99ae388a0130 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:11.867048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a56db1-9627-4309-bfa4-d5ff2c3d4efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:11.867701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a56db1-9627-4309-bfa4-d5ff2c3d4efe admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:11.867980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a56db1-9627-4309-bfa4-d5ff2c3d4efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:11.868289 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a56db1-9627-4309-bfa4-d5ff2c3d4efe admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:11.869008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a56db1-9627-4309-bfa4-d5ff2c3d4efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:11.870577 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a56db1-9627-4309-bfa4-d5ff2c3d4efe admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:11.880798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 986/1993] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:11.885062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1be72-ff64-454e-9dc9-7800b46b1661 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:11.895741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1be72-ff64-454e-9dc9-7800b46b1661 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:11.900432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaf216-1aba-4bfb-9652-dda4985a8486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:11.901570 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaf216-1aba-4bfb-9652-dda4985a8486 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:11.901848 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaf216-1aba-4bfb-9652-dda4985a8486 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:11.902122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eaf216-1aba-4bfb-9652-dda4985a8486 admin admin] PATH_INFO: `/v3/projects/a3d8559254684c6e863af74d6b54f49a/users/ac9e0387590d4ba3a1498ce3c9664d03/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:11.917387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eaf216-1aba-4bfb-9652-dda4985a8486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d8559254684c6e863af74d6b54f49a, user_id=ac9e0387590d4ba3a1498ce3c9664d03, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:11.920147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eaf216-1aba-4bfb-9652-dda4985a8486 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:11.934585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1008/1994] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:11 2022] PUT /identity/v3/projects/a3d8559254684c6e863af74d6b54f49a/users/ac9e0387590d4ba3a1498ce3c9664d03/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:11.944718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052843a9-d4d4-4bf5-bc97-4bc845fef484 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:11.945010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052843a9-d4d4-4bf5-bc97-4bc845fef484 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:11.945942 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052843a9-d4d4-4bf5-bc97-4bc845fef484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:11.974724 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-052843a9-d4d4-4bf5-bc97-4bc845fef484 None None] MFA Rules not processed for user `ac9e0387590d4ba3a1498ce3c9664d03`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:11.975930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-052843a9-d4d4-4bf5-bc97-4bc845fef484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:12.040534 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 987/1995] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:12.050903 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaf216-1aba-4bfb-9652-dda4985a8486 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:12.052754 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f1eaf216-1aba-4bfb-9652-dda4985a8486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:12.107841 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eaf216-1aba-4bfb-9652-dda4985a8486 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:12.111444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe1fca-fd74-4189-a236-472394aab97e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:12.112112 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe1fca-fd74-4189-a236-472394aab97e service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:12.112393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe1fca-fd74-4189-a236-472394aab97e service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:12.112667 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe1fca-fd74-4189-a236-472394aab97e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:12.120687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe1fca-fd74-4189-a236-472394aab97e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:12.122103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe1fca-fd74-4189-a236-472394aab97e service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:12.131224 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1009/1996] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:12 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:13.917580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052843a9-d4d4-4bf5-bc97-4bc845fef484 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:13.919348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-052843a9-d4d4-4bf5-bc97-4bc845fef484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:13.932301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052843a9-d4d4-4bf5-bc97-4bc845fef484 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:13.936403 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64508bc-b8ec-463e-91b6-0d4bac0ee39d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:13.937940 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64508bc-b8ec-463e-91b6-0d4bac0ee39d service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:13.938381 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64508bc-b8ec-463e-91b6-0d4bac0ee39d service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:13.938666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64508bc-b8ec-463e-91b6-0d4bac0ee39d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:13.940569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a64508bc-b8ec-463e-91b6-0d4bac0ee39d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:14.022956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64508bc-b8ec-463e-91b6-0d4bac0ee39d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:14.024915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64508bc-b8ec-463e-91b6-0d4bac0ee39d service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:14.040263 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 988/1997] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:19.232717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe1fca-fd74-4189-a236-472394aab97e service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:19.235025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-70fe1fca-fd74-4189-a236-472394aab97e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:19.316996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe1fca-fd74-4189-a236-472394aab97e service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:19.322069 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:19.323785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:19.324415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:19.324906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] PATH_INFO: `/v3/users/831ae0dc51e2417198b7f01b15b6ad5f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:19.326611 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] RBAC: Authorizing `identity:delete_user(user_id=831ae0dc51e2417198b7f01b15b6ad5f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:19.329390 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:19.385765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831ae0dc51e2417198b7f01b15b6ad5f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:19.414039 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831ae0dc51e2417198b7f01b15b6ad5f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:19.414861 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831ae0dc51e2417198b7f01b15b6ad5f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:19.426398 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831ae0dc51e2417198b7f01b15b6ad5f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:19.435564 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831ae0dc51e2417198b7f01b15b6ad5f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:19.452892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1010/1998] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:19 2022] DELETE /identity/v3/users/831ae0dc51e2417198b7f01b15b6ad5f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:19.458228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a79fa-53a7-4ab5-bd5b-7254531d0f50 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:19.458718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a79fa-53a7-4ab5-bd5b-7254531d0f50 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:19.458827 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a79fa-53a7-4ab5-bd5b-7254531d0f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:19.478929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-140a79fa-53a7-4ab5-bd5b-7254531d0f50 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:19.480167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-140a79fa-53a7-4ab5-bd5b-7254531d0f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:19.553046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 989/1999] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:19.557352 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:19.568959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:19.629472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe7fa5-9e4b-483f-83c2-4375058a85be admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:19.633146 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faa390-100c-4f3a-b8ec-45c030c31f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:19.634345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faa390-100c-4f3a-b8ec-45c030c31f8a service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:19.634345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faa390-100c-4f3a-b8ec-45c030c31f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:19.634549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42faa390-100c-4f3a-b8ec-45c030c31f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:19.650214 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faa390-100c-4f3a-b8ec-45c030c31f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:19.652070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42faa390-100c-4f3a-b8ec-45c030c31f8a service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:19.662494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1011/2000] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:20.022530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a79fa-53a7-4ab5-bd5b-7254531d0f50 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:20.025165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-140a79fa-53a7-4ab5-bd5b-7254531d0f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:20.047816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a79fa-53a7-4ab5-bd5b-7254531d0f50 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:20.058187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:20.059373 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:20.059867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:20.060249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] PATH_INFO: `/v3/projects/2d88e1dfeea241398f5b0fee2f97e03b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:20.061615 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d88e1dfeea241398f5b0fee2f97e03b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:20.065608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:20.122888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d88e1dfeea241398f5b0fee2f97e03b', 'request_id': 'req-d1c85fe3-233c-45aa-82d9-6108da245951'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.131406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d88e1dfeea241398f5b0fee2f97e03b', 'request_id': 'req-d1c85fe3-233c-45aa-82d9-6108da245951'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.138111 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d88e1dfeea241398f5b0fee2f97e03b', 'request_id': 'req-d1c85fe3-233c-45aa-82d9-6108da245951'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.154065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] The token cache is being invalidate because project 2d88e1dfeea241398f5b0fee2f97e03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:20.154466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.155185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.157706 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 990/2001] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:20 2022] DELETE /identity/v3/projects/2d88e1dfeea241398f5b0fee2f97e03b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:20.161683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faa390-100c-4f3a-b8ec-45c030c31f8a service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:20.179438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42faa390-100c-4f3a-b8ec-45c030c31f8a service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:20.238364 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687433b-fdad-4269-a43b-85f38b435228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:20.239239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687433b-fdad-4269-a43b-85f38b435228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:20.239520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687433b-fdad-4269-a43b-85f38b435228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:20.239791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687433b-fdad-4269-a43b-85f38b435228 admin admin] PATH_INFO: `/v3/users/936bdf9fbbff4175ba96ea0c10d02814` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:20.241021 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687433b-fdad-4269-a43b-85f38b435228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=936bdf9fbbff4175ba96ea0c10d02814)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:20.242947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687433b-fdad-4269-a43b-85f38b435228 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:20.291676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e687433b-fdad-4269-a43b-85f38b435228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936bdf9fbbff4175ba96ea0c10d02814'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.305806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:20.307192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:20.314120 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e687433b-fdad-4269-a43b-85f38b435228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936bdf9fbbff4175ba96ea0c10d02814'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.314834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e687433b-fdad-4269-a43b-85f38b435228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936bdf9fbbff4175ba96ea0c10d02814'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.321402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c85fe3-233c-45aa-82d9-6108da245951 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:20.323129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e687433b-fdad-4269-a43b-85f38b435228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936bdf9fbbff4175ba96ea0c10d02814'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.326593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:20.328526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:20.328526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:20.328925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] PATH_INFO: `/v3/users/dc402ff5d1e045eb83221298a8f76b55` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:20.330223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc402ff5d1e045eb83221298a8f76b55)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:20.331767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e687433b-fdad-4269-a43b-85f38b435228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936bdf9fbbff4175ba96ea0c10d02814'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.332322 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:20.338673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1012/2002] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:20 2022] DELETE /identity/v3/users/936bdf9fbbff4175ba96ea0c10d02814 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:20.400886 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc402ff5d1e045eb83221298a8f76b55'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.419542 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc402ff5d1e045eb83221298a8f76b55'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.427658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc402ff5d1e045eb83221298a8f76b55'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.435470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc402ff5d1e045eb83221298a8f76b55'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.436208 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc402ff5d1e045eb83221298a8f76b55'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.444370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 991/2003] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:20 2022] DELETE /identity/v3/users/dc402ff5d1e045eb83221298a8f76b55 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:20.449134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e04e89-6de1-4952-bbf8-dc7113832a26 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:20.449621 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e04e89-6de1-4952-bbf8-dc7113832a26 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:20.449953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e04e89-6de1-4952-bbf8-dc7113832a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:20.475851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c2e04e89-6de1-4952-bbf8-dc7113832a26 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:20.477238 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c2e04e89-6de1-4952-bbf8-dc7113832a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:20.567651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1013/2004] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:20.647514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:20.655551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:20.675299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f065f-fbcc-4c65-99fe-3e0bef863a28 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:20.680684 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:20.682056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:20.682056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:20.682594 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] PATH_INFO: `/v3/projects/367d54bafc2d42099dd57a492fefa749` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:20.684094 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] RBAC: Authorizing `identity:delete_project(project_id=367d54bafc2d42099dd57a492fefa749)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:20.687358 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:20.721578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e04e89-6de1-4952-bbf8-dc7113832a26 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:20.723265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c2e04e89-6de1-4952-bbf8-dc7113832a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:20.760112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367d54bafc2d42099dd57a492fefa749', 'request_id': 'req-4ccda7bb-901d-4a21-90ee-480c0ee3444a'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.765993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367d54bafc2d42099dd57a492fefa749', 'request_id': 'req-4ccda7bb-901d-4a21-90ee-480c0ee3444a'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.773570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367d54bafc2d42099dd57a492fefa749', 'request_id': 'req-4ccda7bb-901d-4a21-90ee-480c0ee3444a'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.789558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] The token cache is being invalidate because project 367d54bafc2d42099dd57a492fefa749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:20.789835 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.790478 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.792402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 992/2005] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:20 2022] DELETE /identity/v3/projects/367d54bafc2d42099dd57a492fefa749 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:20.795272 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e04e89-6de1-4952-bbf8-dc7113832a26 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:20.796810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:20.800863 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:20.850966 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c89c4e-014e-4d81-a83a-d9a594aae08e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:20.851916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c89c4e-014e-4d81-a83a-d9a594aae08e service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:20.852398 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c89c4e-014e-4d81-a83a-d9a594aae08e service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:20.852837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c89c4e-014e-4d81-a83a-d9a594aae08e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:20.855536 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-96c89c4e-014e-4d81-a83a-d9a594aae08e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:20.871841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccda7bb-901d-4a21-90ee-480c0ee3444a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:20.878290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c58889-6693-4c6f-86da-a7ca109026bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:20.879177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c58889-6693-4c6f-86da-a7ca109026bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:20.879574 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c58889-6693-4c6f-86da-a7ca109026bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:20.879854 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c58889-6693-4c6f-86da-a7ca109026bf admin admin] PATH_INFO: `/v3/users/58829cc34e1a4cfdb637b0cc1f36d045` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:20.882125 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c58889-6693-4c6f-86da-a7ca109026bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=58829cc34e1a4cfdb637b0cc1f36d045)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:20.883012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c58889-6693-4c6f-86da-a7ca109026bf admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:20.924315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c89c4e-014e-4d81-a83a-d9a594aae08e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:20.925756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c89c4e-014e-4d81-a83a-d9a594aae08e service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:20.935016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88c58889-6693-4c6f-86da-a7ca109026bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58829cc34e1a4cfdb637b0cc1f36d045'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.935833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1014/2006] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:28:20.948500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88c58889-6693-4c6f-86da-a7ca109026bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58829cc34e1a4cfdb637b0cc1f36d045'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.956526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88c58889-6693-4c6f-86da-a7ca109026bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58829cc34e1a4cfdb637b0cc1f36d045'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.963884 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88c58889-6693-4c6f-86da-a7ca109026bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58829cc34e1a4cfdb637b0cc1f36d045'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.964988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88c58889-6693-4c6f-86da-a7ca109026bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58829cc34e1a4cfdb637b0cc1f36d045'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:20.972059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 993/2007] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:20 2022] DELETE /identity/v3/users/58829cc34e1a4cfdb637b0cc1f36d045 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:21.350022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c89c4e-014e-4d81-a83a-d9a594aae08e service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:21.367823 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c89c4e-014e-4d81-a83a-d9a594aae08e service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:21.476884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f395bf-892f-49aa-83be-c4a9c2693a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:21.478004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f395bf-892f-49aa-83be-c4a9c2693a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:21.478341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f395bf-892f-49aa-83be-c4a9c2693a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:21.478615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f395bf-892f-49aa-83be-c4a9c2693a98 admin admin] PATH_INFO: `/v3/projects/f74a2c6814fb44a0a3093584093e4e0c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:21.481692 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f395bf-892f-49aa-83be-c4a9c2693a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74a2c6814fb44a0a3093584093e4e0c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:21.487316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f395bf-892f-49aa-83be-c4a9c2693a98 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:21.575216 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-32f395bf-892f-49aa-83be-c4a9c2693a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74a2c6814fb44a0a3093584093e4e0c', 'request_id': 'req-32f395bf-892f-49aa-83be-c4a9c2693a98'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:21.584357 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-32f395bf-892f-49aa-83be-c4a9c2693a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74a2c6814fb44a0a3093584093e4e0c', 'request_id': 'req-32f395bf-892f-49aa-83be-c4a9c2693a98'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:21.592004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-32f395bf-892f-49aa-83be-c4a9c2693a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74a2c6814fb44a0a3093584093e4e0c', 'request_id': 'req-32f395bf-892f-49aa-83be-c4a9c2693a98'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:21.608425 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-32f395bf-892f-49aa-83be-c4a9c2693a98 admin admin] The token cache is being invalidate because project f74a2c6814fb44a0a3093584093e4e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:21.609098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-32f395bf-892f-49aa-83be-c4a9c2693a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:21.610125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-32f395bf-892f-49aa-83be-c4a9c2693a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:21.612094 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1015/2008] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:21 2022] DELETE /identity/v3/projects/f74a2c6814fb44a0a3093584093e4e0c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:21.618420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f739569-d3c3-4bb1-82cf-7488a43514f9 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:21.618983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f739569-d3c3-4bb1-82cf-7488a43514f9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:21.619478 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f739569-d3c3-4bb1-82cf-7488a43514f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:21.641312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0f739569-d3c3-4bb1-82cf-7488a43514f9 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:21.642653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0f739569-d3c3-4bb1-82cf-7488a43514f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:21.718510 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 994/2009] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:21.722062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa744d-106f-4bac-8ada-23aac682069f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:21.722567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa744d-106f-4bac-8ada-23aac682069f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:21.722951 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa744d-106f-4bac-8ada-23aac682069f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:21.744925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-14fa744d-106f-4bac-8ada-23aac682069f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:21.746221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-14fa744d-106f-4bac-8ada-23aac682069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:21.756432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1016/2010] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:21.760949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f739569-d3c3-4bb1-82cf-7488a43514f9 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:21.776993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f739569-d3c3-4bb1-82cf-7488a43514f9 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:21.788160 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcabd3c-2a4c-4169-a926-0b91465eaf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:21.790025 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcabd3c-2a4c-4169-a926-0b91465eaf3f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:21.790308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcabd3c-2a4c-4169-a926-0b91465eaf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:21.790583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcabd3c-2a4c-4169-a926-0b91465eaf3f admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:21.791883 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcabd3c-2a4c-4169-a926-0b91465eaf3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:21.792231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcabd3c-2a4c-4169-a926-0b91465eaf3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:21.795446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcabd3c-2a4c-4169-a926-0b91465eaf3f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:21.825385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 995/2011] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:28:21.830579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa744d-106f-4bac-8ada-23aac682069f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:21.842071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa744d-106f-4bac-8ada-23aac682069f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:21.852292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195012-270f-4243-83d6-945ef0ff5b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:21.853386 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195012-270f-4243-83d6-945ef0ff5b73 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:21.853821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195012-270f-4243-83d6-945ef0ff5b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:21.856073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca195012-270f-4243-83d6-945ef0ff5b73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:21.857645 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca195012-270f-4243-83d6-945ef0ff5b73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:21.861652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca195012-270f-4243-83d6-945ef0ff5b73 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:21.904103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1017/2012] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:21 2022] POST /identity/v3/projects => generated 393 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:21.909003 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcabd3c-2a4c-4169-a926-0b91465eaf3f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:21.924105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcabd3c-2a4c-4169-a926-0b91465eaf3f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:21.981478 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195012-270f-4243-83d6-945ef0ff5b73 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:21.984396 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ca195012-270f-4243-83d6-945ef0ff5b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:22.014374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123d84a-bad6-4479-9a8d-58172395fa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:22.017036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123d84a-bad6-4479-9a8d-58172395fa34 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:22.017036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123d84a-bad6-4479-9a8d-58172395fa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:22.017036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123d84a-bad6-4479-9a8d-58172395fa34 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:22.020251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123d84a-bad6-4479-9a8d-58172395fa34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:22.029517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123d84a-bad6-4479-9a8d-58172395fa34 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:22.071528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 996/2013] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:21 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:22.072710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123d84a-bad6-4479-9a8d-58172395fa34 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:22.092671 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123d84a-bad6-4479-9a8d-58172395fa34 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:22.107232 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca195012-270f-4243-83d6-945ef0ff5b73 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:22.107519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de03744-0a05-4c20-a5a2-f20edb9f34d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:22.108252 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de03744-0a05-4c20-a5a2-f20edb9f34d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:22.108628 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de03744-0a05-4c20-a5a2-f20edb9f34d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:22.109379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de03744-0a05-4c20-a5a2-f20edb9f34d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:22.109559 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de03744-0a05-4c20-a5a2-f20edb9f34d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:22.111196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de03744-0a05-4c20-a5a2-f20edb9f34d8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:22.125403 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 997/2014] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:22.125993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de03744-0a05-4c20-a5a2-f20edb9f34d8 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:22.130937 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6616f8-d3ad-47c8-a803-d9bea064d35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:22.131825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6616f8-d3ad-47c8-a803-d9bea064d35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:22.132340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6616f8-d3ad-47c8-a803-d9bea064d35a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:22.132724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6616f8-d3ad-47c8-a803-d9bea064d35a admin admin] PATH_INFO: `/v3/users/9f8274b5f64a4cf3ab7e1a5871f06127` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:22.133830 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-3de03744-0a05-4c20-a5a2-f20edb9f34d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:22.135992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6616f8-d3ad-47c8-a803-d9bea064d35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8274b5f64a4cf3ab7e1a5871f06127)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:22.138039 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6616f8-d3ad-47c8-a803-d9bea064d35a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:22.149369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de03744-0a05-4c20-a5a2-f20edb9f34d8 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:22.155966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:22.156889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:22.157175 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:22.157453 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] PATH_INFO: `/v3/projects/ef61f74c67e54c3b8072bf64255fa453` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:22.159335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef61f74c67e54c3b8072bf64255fa453)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:22.161059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:22.236384 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef61f74c67e54c3b8072bf64255fa453', 'request_id': 'req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:22.241647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6d6616f8-d3ad-47c8-a803-d9bea064d35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8274b5f64a4cf3ab7e1a5871f06127'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:22.243001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef61f74c67e54c3b8072bf64255fa453', 'request_id': 'req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:22.252667 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef61f74c67e54c3b8072bf64255fa453', 'request_id': 'req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:22.256881 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6d6616f8-d3ad-47c8-a803-d9bea064d35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8274b5f64a4cf3ab7e1a5871f06127'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:22.257693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6d6616f8-d3ad-47c8-a803-d9bea064d35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8274b5f64a4cf3ab7e1a5871f06127'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:22.295301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] The token cache is being invalidate because project ef61f74c67e54c3b8072bf64255fa453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:22.296999 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:22.300533 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6d6616f8-d3ad-47c8-a803-d9bea064d35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8274b5f64a4cf3ab7e1a5871f06127'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:22.301115 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:22.304710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 998/2015] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:22 2022] DELETE /identity/v3/projects/ef61f74c67e54c3b8072bf64255fa453 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:22.306862 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:22.310899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:22.325055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6d6616f8-d3ad-47c8-a803-d9bea064d35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8274b5f64a4cf3ab7e1a5871f06127'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:22.333330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1018/2016] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:21 2022] DELETE /identity/v3/users/9f8274b5f64a4cf3ab7e1a5871f06127 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:22.334861 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99063d03-3268-4026-93b1-7357431a8464 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:22.335296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99063d03-3268-4026-93b1-7357431a8464 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:22.336167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99063d03-3268-4026-93b1-7357431a8464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:22.365666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-99063d03-3268-4026-93b1-7357431a8464 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:22.367165 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-99063d03-3268-4026-93b1-7357431a8464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:22.463818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1019/2017] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:22.463818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514693d6-5adf-4638-b9e0-073e96c1b6ca None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:22.463818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514693d6-5adf-4638-b9e0-073e96c1b6ca None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:22.463818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514693d6-5adf-4638-b9e0-073e96c1b6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:22.475161 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59f0bd-f3ea-45ce-bd7b-67d2f212d0ab admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:22.486809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-514693d6-5adf-4638-b9e0-073e96c1b6ca None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:22.488382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-514693d6-5adf-4638-b9e0-073e96c1b6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:22.488727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835650e2-79c8-4ea9-8f7a-35d7e289b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:22.491521 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835650e2-79c8-4ea9-8f7a-35d7e289b0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:22.491521 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835650e2-79c8-4ea9-8f7a-35d7e289b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:22.491521 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835650e2-79c8-4ea9-8f7a-35d7e289b0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:22.493197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835650e2-79c8-4ea9-8f7a-35d7e289b0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:22.499694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835650e2-79c8-4ea9-8f7a-35d7e289b0c2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:22.514915 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1020/2018] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:22.516328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9eec-2fbc-4f3d-9a4e-e67f2ca9ec60 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:22.516616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9eec-2fbc-4f3d-9a4e-e67f2ca9ec60 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:22.516894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b9eec-2fbc-4f3d-9a4e-e67f2ca9ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:22.528863 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 999/2019] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:22.532901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835650e2-79c8-4ea9-8f7a-35d7e289b0c2 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:22.535275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-835650e2-79c8-4ea9-8f7a-35d7e289b0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:22.552563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835650e2-79c8-4ea9-8f7a-35d7e289b0c2 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:22.557618 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe073a0-a236-4e54-9d65-af9fa9e80e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:22.559440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe073a0-a236-4e54-9d65-af9fa9e80e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:22.559725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe073a0-a236-4e54-9d65-af9fa9e80e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:22.559904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4e2b9eec-2fbc-4f3d-9a4e-e67f2ca9ec60 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:22.560013 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe073a0-a236-4e54-9d65-af9fa9e80e23 admin admin] PATH_INFO: `/v3/projects/d36c86643cdd44738c3b9f28face9784/users/53e861d3168e437db8b343fad7779c9c/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:22.561120 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4e2b9eec-2fbc-4f3d-9a4e-e67f2ca9ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:22.581514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1021/2020] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:22.586162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b9eec-2fbc-4f3d-9a4e-e67f2ca9ec60 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:22.595023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe073a0-a236-4e54-9d65-af9fa9e80e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36c86643cdd44738c3b9f28face9784, user_id=53e861d3168e437db8b343fad7779c9c, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:22.602748 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe073a0-a236-4e54-9d65-af9fa9e80e23 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:22.606158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b9eec-2fbc-4f3d-9a4e-e67f2ca9ec60 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:22.623279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a7a00-7ccf-4aad-97c6-10a45a3c4086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:22.625974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7a00-7ccf-4aad-97c6-10a45a3c4086 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:22.630342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7a00-7ccf-4aad-97c6-10a45a3c4086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:22.633222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7a00-7ccf-4aad-97c6-10a45a3c4086 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:22.637770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a7a00-7ccf-4aad-97c6-10a45a3c4086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:22.642293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a7a00-7ccf-4aad-97c6-10a45a3c4086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:22.647730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a7a00-7ccf-4aad-97c6-10a45a3c4086 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:22.659581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1000/2021] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:22 2022] PUT /identity/v3/projects/d36c86643cdd44738c3b9f28face9784/users/53e861d3168e437db8b343fad7779c9c/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:22.659581 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe073a0-a236-4e54-9d65-af9fa9e80e23 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:22.663244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-abe073a0-a236-4e54-9d65-af9fa9e80e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:22.694681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1022/2022] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:28:22.699606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20d5fa-341b-42f6-a674-9040c0deed93 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:22.700809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20d5fa-341b-42f6-a674-9040c0deed93 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:22.701094 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20d5fa-341b-42f6-a674-9040c0deed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:22.765891 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ca20d5fa-341b-42f6-a674-9040c0deed93 None None] MFA Rules not processed for user `53e861d3168e437db8b343fad7779c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:22.767924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ca20d5fa-341b-42f6-a674-9040c0deed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:22.809158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe073a0-a236-4e54-9d65-af9fa9e80e23 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:22.819939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c12e69-50be-48a6-91f5-94c2ef55ea80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:22.820620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c12e69-50be-48a6-91f5-94c2ef55ea80 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:22.820953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c12e69-50be-48a6-91f5-94c2ef55ea80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:22.821170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c12e69-50be-48a6-91f5-94c2ef55ea80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:22.916375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1023/2023] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:22.931043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20d5fa-341b-42f6-a674-9040c0deed93 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.009846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c12e69-50be-48a6-91f5-94c2ef55ea80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:23.011377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c12e69-50be-48a6-91f5-94c2ef55ea80 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:23.053321 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1001/2024] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:23.062939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c12e69-50be-48a6-91f5-94c2ef55ea80 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.087629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c12e69-50be-48a6-91f5-94c2ef55ea80 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:23.097554 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca20d5fa-341b-42f6-a674-9040c0deed93 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:23.108714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fd661-a51f-4dbb-82c5-b3eef6f24cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:23.109188 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fd661-a51f-4dbb-82c5-b3eef6f24cba admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:23.109505 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fd661-a51f-4dbb-82c5-b3eef6f24cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:23.109717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0a0d2-3137-4b97-9e83-f24b59f02bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:23.109842 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fd661-a51f-4dbb-82c5-b3eef6f24cba admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:23.110512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fd661-a51f-4dbb-82c5-b3eef6f24cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:23.111099 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a0d2-3137-4b97-9e83-f24b59f02bba admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:23.111462 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a0d2-3137-4b97-9e83-f24b59f02bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:23.111813 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a0d2-3137-4b97-9e83-f24b59f02bba admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:23.113441 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fd661-a51f-4dbb-82c5-b3eef6f24cba admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:23.113587 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0a0d2-3137-4b97-9e83-f24b59f02bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:23.115638 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0a0d2-3137-4b97-9e83-f24b59f02bba admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:23.152205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1024/2025] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:22 2022] POST /identity/v3/projects => generated 371 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:23.154991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0a0d2-3137-4b97-9e83-f24b59f02bba admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.181853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1002/2026] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:23 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:23.186151 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fd661-a51f-4dbb-82c5-b3eef6f24cba admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.297771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0a0d2-3137-4b97-9e83-f24b59f02bba admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:23.349342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fd661-a51f-4dbb-82c5-b3eef6f24cba admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:23.360244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d266007-5d8a-43dc-b51e-cb195da0593f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:23.362901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266007-5d8a-43dc-b51e-cb195da0593f admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:23.363857 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266007-5d8a-43dc-b51e-cb195da0593f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:23.364609 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d266007-5d8a-43dc-b51e-cb195da0593f admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:23.366788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d266007-5d8a-43dc-b51e-cb195da0593f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:23.368858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d266007-5d8a-43dc-b51e-cb195da0593f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:23.414384 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a809ab-6b09-4ad9-a1e2-65592359eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:23.415125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a809ab-6b09-4ad9-a1e2-65592359eec4 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:23.415844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a809ab-6b09-4ad9-a1e2-65592359eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:23.416261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a809ab-6b09-4ad9-a1e2-65592359eec4 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:23.417091 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a809ab-6b09-4ad9-a1e2-65592359eec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:23.419143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a809ab-6b09-4ad9-a1e2-65592359eec4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:23.425739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1003/2027] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:23 2022] POST /identity/v3/users => generated 302 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:23.427070 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d266007-5d8a-43dc-b51e-cb195da0593f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.455688 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1025/2028] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:23 2022] POST /identity/v3/users => generated 286 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:23.456042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d266007-5d8a-43dc-b51e-cb195da0593f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:23.456530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a809ab-6b09-4ad9-a1e2-65592359eec4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.468838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a4ddb-405a-4594-a5c7-05fa47e82463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:23.469422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a4ddb-405a-4594-a5c7-05fa47e82463 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:23.471881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a4ddb-405a-4594-a5c7-05fa47e82463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:23.472206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a4ddb-405a-4594-a5c7-05fa47e82463 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:23.472322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a809ab-6b09-4ad9-a1e2-65592359eec4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:23.472966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a4ddb-405a-4594-a5c7-05fa47e82463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:23.476345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a4ddb-405a-4594-a5c7-05fa47e82463 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:23.478966 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c67f91-41a5-4676-a136-b0f54f3838bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:23.480115 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c67f91-41a5-4676-a136-b0f54f3838bb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:23.480415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c67f91-41a5-4676-a136-b0f54f3838bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:23.480696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c67f91-41a5-4676-a136-b0f54f3838bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:23.481744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c67f91-41a5-4676-a136-b0f54f3838bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:23.483394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c67f91-41a5-4676-a136-b0f54f3838bb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:23.497009 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1026/2029] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:23.501832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c67f91-41a5-4676-a136-b0f54f3838bb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.514315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1004/2030] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:23.516816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a4ddb-405a-4594-a5c7-05fa47e82463 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.522682 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c67f91-41a5-4676-a136-b0f54f3838bb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:23.528338 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6bbf4-dcb6-4f70-91f9-f0fa3d9cebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:23.528960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a4ddb-405a-4594-a5c7-05fa47e82463 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:23.529135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6bbf4-dcb6-4f70-91f9-f0fa3d9cebfa admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:23.529428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6bbf4-dcb6-4f70-91f9-f0fa3d9cebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:23.529709 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6bbf4-dcb6-4f70-91f9-f0fa3d9cebfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:23.530473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6bbf4-dcb6-4f70-91f9-f0fa3d9cebfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:23.532224 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6bbf4-dcb6-4f70-91f9-f0fa3d9cebfa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:23.552150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1027/2031] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:23.552818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a5e0e-2b44-474b-96e4-8d2347307185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:23.553183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6bbf4-dcb6-4f70-91f9-f0fa3d9cebfa admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.554340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a5e0e-2b44-474b-96e4-8d2347307185 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:23.554794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a5e0e-2b44-474b-96e4-8d2347307185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:23.556468 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a5e0e-2b44-474b-96e4-8d2347307185 admin admin] PATH_INFO: `/v3/projects/339b2fcdcb0f400ab13bd017800cd305/users/975be93aecc745d1bdfe3a576eab2d93/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:23.564536 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6bbf4-dcb6-4f70-91f9-f0fa3d9cebfa admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:23.569406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bd0d1-0476-40e2-9e1e-61f9f36ab9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:23.570395 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bd0d1-0476-40e2-9e1e-61f9f36ab9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:23.570685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bd0d1-0476-40e2-9e1e-61f9f36ab9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:23.570965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bd0d1-0476-40e2-9e1e-61f9f36ab9c9 admin admin] PATH_INFO: `/v3/projects/e2e9a4fdafaf4200a5248f842d5757f3/users/69e6d88b925e4de39d46951b84cb7bc9/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:23.590296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bd0d1-0476-40e2-9e1e-61f9f36ab9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e9a4fdafaf4200a5248f842d5757f3, user_id=69e6d88b925e4de39d46951b84cb7bc9, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:23.593915 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bd0d1-0476-40e2-9e1e-61f9f36ab9c9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:23.614693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a5e0e-2b44-474b-96e4-8d2347307185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339b2fcdcb0f400ab13bd017800cd305, user_id=975be93aecc745d1bdfe3a576eab2d93, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:23.617715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a5e0e-2b44-474b-96e4-8d2347307185 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:23.620383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1028/2032] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:23 2022] PUT /identity/v3/projects/e2e9a4fdafaf4200a5248f842d5757f3/users/69e6d88b925e4de39d46951b84cb7bc9/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:23.634441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6f88d-5a2a-4ccd-9197-b684b9574950 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:23.635277 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6f88d-5a2a-4ccd-9197-b684b9574950 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:23.636079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6f88d-5a2a-4ccd-9197-b684b9574950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:23.662264 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1005/2033] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:23 2022] PUT /identity/v3/projects/339b2fcdcb0f400ab13bd017800cd305/users/975be93aecc745d1bdfe3a576eab2d93/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:23.666404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a5e0e-2b44-474b-96e4-8d2347307185 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.686399 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-87b6f88d-5a2a-4ccd-9197-b684b9574950 None None] MFA Rules not processed for user `69e6d88b925e4de39d46951b84cb7bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:23.689045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-87b6f88d-5a2a-4ccd-9197-b684b9574950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:23.769019 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a5e0e-2b44-474b-96e4-8d2347307185 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:23.775811 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52c58a-de51-4781-9d12-ecae90744efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:23.778108 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52c58a-de51-4781-9d12-ecae90744efc admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:23.778550 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52c58a-de51-4781-9d12-ecae90744efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:23.779263 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52c58a-de51-4781-9d12-ecae90744efc admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:23.780171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52c58a-de51-4781-9d12-ecae90744efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:23.783054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52c58a-de51-4781-9d12-ecae90744efc admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:23.797413 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1006/2034] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:23.802023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52c58a-de51-4781-9d12-ecae90744efc admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.831226 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52c58a-de51-4781-9d12-ecae90744efc admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:23.848694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230fee7-6fa1-4b89-942b-b6cddfef1242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:23.849920 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230fee7-6fa1-4b89-942b-b6cddfef1242 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:23.850273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230fee7-6fa1-4b89-942b-b6cddfef1242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:23.853403 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230fee7-6fa1-4b89-942b-b6cddfef1242 admin admin] PATH_INFO: `/v3/projects/339b2fcdcb0f400ab13bd017800cd305/users/975be93aecc745d1bdfe3a576eab2d93/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:23.854745 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230fee7-6fa1-4b89-942b-b6cddfef1242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=339b2fcdcb0f400ab13bd017800cd305, user_id=975be93aecc745d1bdfe3a576eab2d93, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:23.862882 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1029/2035] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:23.862882 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6f88d-5a2a-4ccd-9197-b684b9574950 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.865272 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-87b6f88d-5a2a-4ccd-9197-b684b9574950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:23.870520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230fee7-6fa1-4b89-942b-b6cddfef1242 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:23.912576 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1007/2036] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:23 2022] PUT /identity/v3/projects/339b2fcdcb0f400ab13bd017800cd305/users/975be93aecc745d1bdfe3a576eab2d93/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:23.912576 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230fee7-6fa1-4b89-942b-b6cddfef1242 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:23.913658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d230fee7-6fa1-4b89-942b-b6cddfef1242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:23.926905 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6f88d-5a2a-4ccd-9197-b684b9574950 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:24.022276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230fee7-6fa1-4b89-942b-b6cddfef1242 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:24.027368 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bf00a-fa10-48dd-b214-12d84d4c7413 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5074090dca0b4a49b54dc252a5dd9420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:24.028740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bf00a-fa10-48dd-b214-12d84d4c7413 service glance] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:24.029040 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bf00a-fa10-48dd-b214-12d84d4c7413 service glance] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:24.029323 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bf00a-fa10-48dd-b214-12d84d4c7413 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:24.070253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:24.071256 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:24.071535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:24.071965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] PATH_INFO: `/v3/projects/20b0954db48a4eb5a0928c9ffddb3aeb` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:24.079904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b0954db48a4eb5a0928c9ffddb3aeb)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:24.082826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:24.119657 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bf00a-fa10-48dd-b214-12d84d4c7413 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:24.123622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bf00a-fa10-48dd-b214-12d84d4c7413 service glance] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:24.145311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1008/2037] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:24.146883 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a926f-0c76-4871-ad1b-be8f461a120c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:24.147179 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a926f-0c76-4871-ad1b-be8f461a120c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:24.147461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a926f-0c76-4871-ad1b-be8f461a120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:24.193141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b0954db48a4eb5a0928c9ffddb3aeb', 'request_id': 'req-22d18934-c23c-431a-acfc-8db0c3c9cf4d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:24.207070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b0954db48a4eb5a0928c9ffddb3aeb', 'request_id': 'req-22d18934-c23c-431a-acfc-8db0c3c9cf4d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:24.207266 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-cc6a926f-0c76-4871-ad1b-be8f461a120c None None] MFA Rules not processed for user `975be93aecc745d1bdfe3a576eab2d93`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:24.210776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-cc6a926f-0c76-4871-ad1b-be8f461a120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:24.214123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b0954db48a4eb5a0928c9ffddb3aeb', 'request_id': 'req-22d18934-c23c-431a-acfc-8db0c3c9cf4d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:24.243649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] The token cache is being invalidate because project 20b0954db48a4eb5a0928c9ffddb3aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:24.244095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:24.244828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:24.246860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1030/2038] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:23 2022] DELETE /identity/v3/projects/20b0954db48a4eb5a0928c9ffddb3aeb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:24.254783 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:24.256911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:24.357255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d18934-c23c-431a-acfc-8db0c3c9cf4d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:24.364891 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:24.365480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1009/2039] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:24.366108 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:24.366446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:24.366872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] PATH_INFO: `/v3/users/bd438d2731fa47d0bedce8e35bb8fc1b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:24.368283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd438d2731fa47d0bedce8e35bb8fc1b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:24.373194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:24.391735 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a926f-0c76-4871-ad1b-be8f461a120c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:24.393233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-cc6a926f-0c76-4871-ad1b-be8f461a120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:24.449742 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd438d2731fa47d0bedce8e35bb8fc1b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:24.466693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd438d2731fa47d0bedce8e35bb8fc1b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:24.467384 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd438d2731fa47d0bedce8e35bb8fc1b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:24.476159 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd438d2731fa47d0bedce8e35bb8fc1b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:24.484828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd438d2731fa47d0bedce8e35bb8fc1b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:24.485496 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a926f-0c76-4871-ad1b-be8f461a120c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:24.491120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf04d0-111b-4005-b06a-60de10b8bdcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:24.491300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1031/2040] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:24 2022] DELETE /identity/v3/users/bd438d2731fa47d0bedce8e35bb8fc1b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:24.492666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf04d0-111b-4005-b06a-60de10b8bdcf service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:24.493155 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf04d0-111b-4005-b06a-60de10b8bdcf service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:24.493760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf04d0-111b-4005-b06a-60de10b8bdcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:24.497032 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0ecf04d0-111b-4005-b06a-60de10b8bdcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:24.513598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf04d0-111b-4005-b06a-60de10b8bdcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:24.515652 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf04d0-111b-4005-b06a-60de10b8bdcf service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:24.527986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1010/2041] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:24.639285 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:24.640978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:24.731716 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e9499-897a-435f-ba07-129be324d505 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:24.749007 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452d8ab-5375-440a-8fc9-6712ff22ab92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:24.755093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452d8ab-5375-440a-8fc9-6712ff22ab92 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:24.755611 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452d8ab-5375-440a-8fc9-6712ff22ab92 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:24.756254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452d8ab-5375-440a-8fc9-6712ff22ab92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:24.763057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c452d8ab-5375-440a-8fc9-6712ff22ab92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:24.818041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf04d0-111b-4005-b06a-60de10b8bdcf service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:24.831415 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0ecf04d0-111b-4005-b06a-60de10b8bdcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:24.859119 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf04d0-111b-4005-b06a-60de10b8bdcf service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:24.874366 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452d8ab-5375-440a-8fc9-6712ff22ab92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:24.876106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452d8ab-5375-440a-8fc9-6712ff22ab92 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:24.887929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1032/2042] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:24.937243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e353fe0-0750-4a44-9fac-40abe405e80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:24.938140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e353fe0-0750-4a44-9fac-40abe405e80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:24.938424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e353fe0-0750-4a44-9fac-40abe405e80b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:24.938700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e353fe0-0750-4a44-9fac-40abe405e80b admin admin] PATH_INFO: `/v3/projects/93165e235c0148e9b4825d8804f555a6` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:24.940171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e353fe0-0750-4a44-9fac-40abe405e80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=93165e235c0148e9b4825d8804f555a6)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:24.942929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e353fe0-0750-4a44-9fac-40abe405e80b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:25.020828 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7e353fe0-0750-4a44-9fac-40abe405e80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93165e235c0148e9b4825d8804f555a6', 'request_id': 'req-7e353fe0-0750-4a44-9fac-40abe405e80b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:25.029664 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7e353fe0-0750-4a44-9fac-40abe405e80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93165e235c0148e9b4825d8804f555a6', 'request_id': 'req-7e353fe0-0750-4a44-9fac-40abe405e80b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:25.047630 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7e353fe0-0750-4a44-9fac-40abe405e80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93165e235c0148e9b4825d8804f555a6', 'request_id': 'req-7e353fe0-0750-4a44-9fac-40abe405e80b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:25.068615 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7e353fe0-0750-4a44-9fac-40abe405e80b admin admin] The token cache is being invalidate because project 93165e235c0148e9b4825d8804f555a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:25.068907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7e353fe0-0750-4a44-9fac-40abe405e80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:25.069815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7e353fe0-0750-4a44-9fac-40abe405e80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:25.071881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1011/2043] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:24 2022] DELETE /identity/v3/projects/93165e235c0148e9b4825d8804f555a6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:25.078260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0979c1-043f-4f3b-bd49-3e2ab5775a10 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.078621 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0979c1-043f-4f3b-bd49-3e2ab5775a10 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.078902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0979c1-043f-4f3b-bd49-3e2ab5775a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.112448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-db0979c1-043f-4f3b-bd49-3e2ab5775a10 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:25.114390 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-db0979c1-043f-4f3b-bd49-3e2ab5775a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:25.200234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1033/2044] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:25.202692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be1ad9-c50c-4097-bb93-067e7ed92ad0 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.203135 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be1ad9-c50c-4097-bb93-067e7ed92ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.203614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be1ad9-c50c-4097-bb93-067e7ed92ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.233769 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-e2be1ad9-c50c-4097-bb93-067e7ed92ad0 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:25.234975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e2be1ad9-c50c-4097-bb93-067e7ed92ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:25.244219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1012/2045] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:25.256212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0979c1-043f-4f3b-bd49-3e2ab5775a10 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:25.259218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0979c1-043f-4f3b-bd49-3e2ab5775a10 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:25.264348 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c4f24-9a5c-47cc-a3ff-fc5221f6964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:25.265600 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c4f24-9a5c-47cc-a3ff-fc5221f6964b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.265889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c4f24-9a5c-47cc-a3ff-fc5221f6964b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.266167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c4f24-9a5c-47cc-a3ff-fc5221f6964b admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.266940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c4f24-9a5c-47cc-a3ff-fc5221f6964b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:25.267248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c4f24-9a5c-47cc-a3ff-fc5221f6964b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:25.268933 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c4f24-9a5c-47cc-a3ff-fc5221f6964b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:25.287298 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1034/2046] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:28:25.288436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be1ad9-c50c-4097-bb93-067e7ed92ad0 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:25.298528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be1ad9-c50c-4097-bb93-067e7ed92ad0 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:25.308208 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66c347-7b06-4e36-bd68-c360950e9879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:25.308899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66c347-7b06-4e36-bd68-c360950e9879 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.309329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66c347-7b06-4e36-bd68-c360950e9879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.309597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66c347-7b06-4e36-bd68-c360950e9879 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.310368 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66c347-7b06-4e36-bd68-c360950e9879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:25.312781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66c347-7b06-4e36-bd68-c360950e9879 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:25.344734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1013/2047] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:25 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:25.348854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c4f24-9a5c-47cc-a3ff-fc5221f6964b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:25.360153 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c4f24-9a5c-47cc-a3ff-fc5221f6964b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:25.430363 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862cfb5-a887-4792-922d-04940b0d96d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:25.431034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862cfb5-a887-4792-922d-04940b0d96d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.431411 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862cfb5-a887-4792-922d-04940b0d96d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.431684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862cfb5-a887-4792-922d-04940b0d96d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.432564 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862cfb5-a887-4792-922d-04940b0d96d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:25.434552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862cfb5-a887-4792-922d-04940b0d96d5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:25.458718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1035/2048] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:25 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:25.463054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66c347-7b06-4e36-bd68-c360950e9879 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:25.476560 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66c347-7b06-4e36-bd68-c360950e9879 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:25.481359 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698b9d9-6af2-46a6-b8f4-0811ea424b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:25.482045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698b9d9-6af2-46a6-b8f4-0811ea424b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.482325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698b9d9-6af2-46a6-b8f4-0811ea424b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.482600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698b9d9-6af2-46a6-b8f4-0811ea424b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.483335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698b9d9-6af2-46a6-b8f4-0811ea424b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:25.485485 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698b9d9-6af2-46a6-b8f4-0811ea424b5a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:25.500316 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1014/2049] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:25.501833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862cfb5-a887-4792-922d-04940b0d96d5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:25.515115 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862cfb5-a887-4792-922d-04940b0d96d5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:25.520102 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f5abc-d20b-44db-ae60-681b697c5d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:25.520800 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5abc-d20b-44db-ae60-681b697c5d83 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.521088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5abc-d20b-44db-ae60-681b697c5d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.521361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f5abc-d20b-44db-ae60-681b697c5d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.522123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f5abc-d20b-44db-ae60-681b697c5d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:25.523737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f5abc-d20b-44db-ae60-681b697c5d83 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:25.538321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1036/2050] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:25.540016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698b9d9-6af2-46a6-b8f4-0811ea424b5a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:25.550643 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698b9d9-6af2-46a6-b8f4-0811ea424b5a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:25.555660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5ac6b-a385-4d8e-8e87-fae5413212ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:25.556570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5ac6b-a385-4d8e-8e87-fae5413212ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.556853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5ac6b-a385-4d8e-8e87-fae5413212ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.557128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5ac6b-a385-4d8e-8e87-fae5413212ee admin admin] PATH_INFO: `/v3/projects/fd707433bf674e30a67fd867d398c291/users/c1c1cb5446f34fccbcfdfca51f94dc8b/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.572799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5ac6b-a385-4d8e-8e87-fae5413212ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd707433bf674e30a67fd867d398c291, user_id=c1c1cb5446f34fccbcfdfca51f94dc8b, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:25.575501 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5ac6b-a385-4d8e-8e87-fae5413212ee admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:25.589374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1015/2051] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:25 2022] PUT /identity/v3/projects/fd707433bf674e30a67fd867d398c291/users/c1c1cb5446f34fccbcfdfca51f94dc8b/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:25.600230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca7fd-82d5-46ab-86bb-c55e278fa16d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.600520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca7fd-82d5-46ab-86bb-c55e278fa16d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.600795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca7fd-82d5-46ab-86bb-c55e278fa16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.627517 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b48ca7fd-82d5-46ab-86bb-c55e278fa16d None None] MFA Rules not processed for user `c1c1cb5446f34fccbcfdfca51f94dc8b`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:25.628762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b48ca7fd-82d5-46ab-86bb-c55e278fa16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:25.695393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1037/2052] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:25.700090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5ac6b-a385-4d8e-8e87-fae5413212ee admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:25.766177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5ac6b-a385-4d8e-8e87-fae5413212ee admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:25.770786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27acf4-8ad3-46fa-b815-015ef645c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:25.771433 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27acf4-8ad3-46fa-b815-015ef645c090 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.771711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27acf4-8ad3-46fa-b815-015ef645c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.771986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27acf4-8ad3-46fa-b815-015ef645c090 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.772705 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27acf4-8ad3-46fa-b815-015ef645c090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:25.774585 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27acf4-8ad3-46fa-b815-015ef645c090 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:25.798251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1016/2053] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:25 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:25.802202 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ca7fd-82d5-46ab-86bb-c55e278fa16d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:25.812995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ca7fd-82d5-46ab-86bb-c55e278fa16d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:25.881502 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b737565-b6d0-4d82-b075-98b673595f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:25.882435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b737565-b6d0-4d82-b075-98b673595f10 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.882750 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b737565-b6d0-4d82-b075-98b673595f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.883057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b737565-b6d0-4d82-b075-98b673595f10 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.883896 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b737565-b6d0-4d82-b075-98b673595f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:25.885892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b737565-b6d0-4d82-b075-98b673595f10 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:25.907075 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1038/2054] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:25 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:25.911153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27acf4-8ad3-46fa-b815-015ef645c090 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:25.922034 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27acf4-8ad3-46fa-b815-015ef645c090 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:25.926674 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaba05-6b02-463d-80ed-478872f8538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:25.927332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaba05-6b02-463d-80ed-478872f8538d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.927611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaba05-6b02-463d-80ed-478872f8538d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.927884 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaba05-6b02-463d-80ed-478872f8538d admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.928631 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaba05-6b02-463d-80ed-478872f8538d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:25.930214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaba05-6b02-463d-80ed-478872f8538d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:25.941568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1017/2055] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:25.945792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b737565-b6d0-4d82-b075-98b673595f10 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:25.956483 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b737565-b6d0-4d82-b075-98b673595f10 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:25.961099 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288bcf2-0cbb-435c-8e98-7caecdd0d362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:25.961966 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288bcf2-0cbb-435c-8e98-7caecdd0d362 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:25.962250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288bcf2-0cbb-435c-8e98-7caecdd0d362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:25.962521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288bcf2-0cbb-435c-8e98-7caecdd0d362 admin admin] PATH_INFO: `/v3/projects/c4654e14fcbd45f8b08e05b152b31eb8/users/23455b104b8e4e2cbbe375f930f940f2/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:25.976885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288bcf2-0cbb-435c-8e98-7caecdd0d362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4654e14fcbd45f8b08e05b152b31eb8, user_id=23455b104b8e4e2cbbe375f930f940f2, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:25.979556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288bcf2-0cbb-435c-8e98-7caecdd0d362 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:25.992922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1039/2056] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:25 2022] PUT /identity/v3/projects/c4654e14fcbd45f8b08e05b152b31eb8/users/23455b104b8e4e2cbbe375f930f940f2/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:25.997011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaba05-6b02-463d-80ed-478872f8538d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:26.007982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaba05-6b02-463d-80ed-478872f8538d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:26.064149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11aa89-3184-499f-aafa-946d4f9d5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:26.064819 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11aa89-3184-499f-aafa-946d4f9d5da7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:26.065104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11aa89-3184-499f-aafa-946d4f9d5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:26.065378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11aa89-3184-499f-aafa-946d4f9d5da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:26.066090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11aa89-3184-499f-aafa-946d4f9d5da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:26.067686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11aa89-3184-499f-aafa-946d4f9d5da7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:26.077147 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1018/2057] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:26.081602 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288bcf2-0cbb-435c-8e98-7caecdd0d362 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:26.091385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288bcf2-0cbb-435c-8e98-7caecdd0d362 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:26.096289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa56a0-24d6-4b38-bae6-1b9886ab43c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:26.097150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa56a0-24d6-4b38-bae6-1b9886ab43c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:26.097428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa56a0-24d6-4b38-bae6-1b9886ab43c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:26.097695 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa56a0-24d6-4b38-bae6-1b9886ab43c4 admin admin] PATH_INFO: `/v3/projects/c4654e14fcbd45f8b08e05b152b31eb8/users/23455b104b8e4e2cbbe375f930f940f2/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:26.099620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa56a0-24d6-4b38-bae6-1b9886ab43c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4654e14fcbd45f8b08e05b152b31eb8, user_id=23455b104b8e4e2cbbe375f930f940f2, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:26.102274 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa56a0-24d6-4b38-bae6-1b9886ab43c4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:26.112866 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1040/2058] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:26 2022] PUT /identity/v3/projects/c4654e14fcbd45f8b08e05b152b31eb8/users/23455b104b8e4e2cbbe375f930f940f2/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:26.123777 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f4dba-f2fb-4a11-b13c-65a2e7e60ec4 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:26.124744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f4dba-f2fb-4a11-b13c-65a2e7e60ec4 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:26.125025 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f4dba-f2fb-4a11-b13c-65a2e7e60ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:26.150781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-196f4dba-f2fb-4a11-b13c-65a2e7e60ec4 None None] MFA Rules not processed for user `23455b104b8e4e2cbbe375f930f940f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:26.152305 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-196f4dba-f2fb-4a11-b13c-65a2e7e60ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:26.216269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1019/2059] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:26.225738 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa56a0-24d6-4b38-bae6-1b9886ab43c4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:26.227568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ecfa56a0-24d6-4b38-bae6-1b9886ab43c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:26.286114 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa56a0-24d6-4b38-bae6-1b9886ab43c4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:26.289799 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26e01d-148a-4fe8-86bd-a004c1635272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:26.290435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26e01d-148a-4fe8-86bd-a004c1635272 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:26.290717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26e01d-148a-4fe8-86bd-a004c1635272 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:26.291070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26e01d-148a-4fe8-86bd-a004c1635272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:26.300871 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26e01d-148a-4fe8-86bd-a004c1635272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:26.302301 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26e01d-148a-4fe8-86bd-a004c1635272 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:26.312483 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1041/2060] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:26.692174 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f4dba-f2fb-4a11-b13c-65a2e7e60ec4 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:26.764068 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f4dba-f2fb-4a11-b13c-65a2e7e60ec4 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:26.769488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:26.770405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:26.770634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:26.770909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] PATH_INFO: `/v3/users/c1c1cb5446f34fccbcfdfca51f94dc8b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:26.772134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c1cb5446f34fccbcfdfca51f94dc8b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:26.774075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:26.821352 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c1cb5446f34fccbcfdfca51f94dc8b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:26.833548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c1cb5446f34fccbcfdfca51f94dc8b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:26.840815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c1cb5446f34fccbcfdfca51f94dc8b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:26.848364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c1cb5446f34fccbcfdfca51f94dc8b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:26.849013 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c1cb5446f34fccbcfdfca51f94dc8b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:26.855079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1020/2061] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:26 2022] DELETE /identity/v3/users/c1c1cb5446f34fccbcfdfca51f94dc8b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:26.859688 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830aff-beb9-4b8d-bfa3-d9ae9c4f9b54 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:26.859688 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830aff-beb9-4b8d-bfa3-d9ae9c4f9b54 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:26.860981 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830aff-beb9-4b8d-bfa3-d9ae9c4f9b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:26.880420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5d830aff-beb9-4b8d-bfa3-d9ae9c4f9b54 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:26.881640 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5d830aff-beb9-4b8d-bfa3-d9ae9c4f9b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:26.957035 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1042/2062] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:26.967517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:26.970153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:27.027528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7a939-c94f-4319-97be-aca46e1db465 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:27.031904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de399e4-f622-48f9-9f8c-d4f8e1606504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:27.032730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de399e4-f622-48f9-9f8c-d4f8e1606504 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:27.033015 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de399e4-f622-48f9-9f8c-d4f8e1606504 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:27.033292 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de399e4-f622-48f9-9f8c-d4f8e1606504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:27.042512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de399e4-f622-48f9-9f8c-d4f8e1606504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:27.044015 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de399e4-f622-48f9-9f8c-d4f8e1606504 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:27.053764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1021/2063] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:27.316365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d830aff-beb9-4b8d-bfa3-d9ae9c4f9b54 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:27.317956 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5d830aff-beb9-4b8d-bfa3-d9ae9c4f9b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:27.339566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d830aff-beb9-4b8d-bfa3-d9ae9c4f9b54 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:27.344913 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:27.345777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:27.346098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:27.346408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] PATH_INFO: `/v3/projects/fd707433bf674e30a67fd867d398c291` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:27.347610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd707433bf674e30a67fd867d398c291)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:27.349574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:27.395587 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd707433bf674e30a67fd867d398c291', 'request_id': 'req-9c11f1c9-920a-465c-ba50-28acec84dd81'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:27.400856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd707433bf674e30a67fd867d398c291', 'request_id': 'req-9c11f1c9-920a-465c-ba50-28acec84dd81'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:27.407285 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd707433bf674e30a67fd867d398c291', 'request_id': 'req-9c11f1c9-920a-465c-ba50-28acec84dd81'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:27.419915 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] The token cache is being invalidate because project fd707433bf674e30a67fd867d398c291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:27.420463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:27.421356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:27.422894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1043/2064] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:27 2022] DELETE /identity/v3/projects/fd707433bf674e30a67fd867d398c291 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:27.426809 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de399e4-f622-48f9-9f8c-d4f8e1606504 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:27.436164 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de399e4-f622-48f9-9f8c-d4f8e1606504 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:27.490195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1db346-1a68-4fff-b398-fe23394ac303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:27.491065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1db346-1a68-4fff-b398-fe23394ac303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:27.491343 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1db346-1a68-4fff-b398-fe23394ac303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:27.491669 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1db346-1a68-4fff-b398-fe23394ac303 admin admin] PATH_INFO: `/v3/users/23455b104b8e4e2cbbe375f930f940f2` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:27.492944 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1db346-1a68-4fff-b398-fe23394ac303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23455b104b8e4e2cbbe375f930f940f2)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:27.494852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1db346-1a68-4fff-b398-fe23394ac303 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:27.540389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ad1db346-1a68-4fff-b398-fe23394ac303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23455b104b8e4e2cbbe375f930f940f2'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:27.551902 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ad1db346-1a68-4fff-b398-fe23394ac303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23455b104b8e4e2cbbe375f930f940f2'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:27.558469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ad1db346-1a68-4fff-b398-fe23394ac303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23455b104b8e4e2cbbe375f930f940f2'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:27.565892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ad1db346-1a68-4fff-b398-fe23394ac303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23455b104b8e4e2cbbe375f930f940f2'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:27.566551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ad1db346-1a68-4fff-b398-fe23394ac303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23455b104b8e4e2cbbe375f930f940f2'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:27.572419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1022/2065] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:27 2022] DELETE /identity/v3/users/23455b104b8e4e2cbbe375f930f940f2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:27.850615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:27.852101 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:27.867474 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11f1c9-920a-465c-ba50-28acec84dd81 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:27.928513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c493c05-b99c-4672-913c-3e4f657b7107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:27.929394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c493c05-b99c-4672-913c-3e4f657b7107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:27.929672 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c493c05-b99c-4672-913c-3e4f657b7107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:27.929947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c493c05-b99c-4672-913c-3e4f657b7107 admin admin] PATH_INFO: `/v3/projects/c4654e14fcbd45f8b08e05b152b31eb8` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:27.931174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c493c05-b99c-4672-913c-3e4f657b7107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4654e14fcbd45f8b08e05b152b31eb8)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:27.933142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c493c05-b99c-4672-913c-3e4f657b7107 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:27.980566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6c493c05-b99c-4672-913c-3e4f657b7107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4654e14fcbd45f8b08e05b152b31eb8', 'request_id': 'req-6c493c05-b99c-4672-913c-3e4f657b7107'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:27.987105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6c493c05-b99c-4672-913c-3e4f657b7107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4654e14fcbd45f8b08e05b152b31eb8', 'request_id': 'req-6c493c05-b99c-4672-913c-3e4f657b7107'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:27.993430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6c493c05-b99c-4672-913c-3e4f657b7107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4654e14fcbd45f8b08e05b152b31eb8', 'request_id': 'req-6c493c05-b99c-4672-913c-3e4f657b7107'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:28.005639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6c493c05-b99c-4672-913c-3e4f657b7107 admin admin] The token cache is being invalidate because project c4654e14fcbd45f8b08e05b152b31eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:28.005926 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6c493c05-b99c-4672-913c-3e4f657b7107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:28.006848 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6c493c05-b99c-4672-913c-3e4f657b7107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:28.009335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1044/2066] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:27 2022] DELETE /identity/v3/projects/c4654e14fcbd45f8b08e05b152b31eb8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:28.014632 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00119f86-13bf-4996-a6d0-5635321184fe None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:28.015211 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00119f86-13bf-4996-a6d0-5635321184fe None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:28.015443 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00119f86-13bf-4996-a6d0-5635321184fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:28.034238 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-00119f86-13bf-4996-a6d0-5635321184fe None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:28.035624 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-00119f86-13bf-4996-a6d0-5635321184fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:28.091363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1023/2067] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:28.099586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd4a4a-4092-415b-bb87-8584d1e0db52 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:28.099954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd4a4a-4092-415b-bb87-8584d1e0db52 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:28.100276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd4a4a-4092-415b-bb87-8584d1e0db52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:28.118716 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-46cd4a4a-4092-415b-bb87-8584d1e0db52 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:28.119910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-46cd4a4a-4092-415b-bb87-8584d1e0db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:28.127814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1045/2068] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:28.131953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00119f86-13bf-4996-a6d0-5635321184fe None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:28.141546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00119f86-13bf-4996-a6d0-5635321184fe None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:28.146082 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b9fdd-0e72-4aad-9479-31addd31ac81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:28.146732 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b9fdd-0e72-4aad-9479-31addd31ac81 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:28.147009 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b9fdd-0e72-4aad-9479-31addd31ac81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:28.147277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b9fdd-0e72-4aad-9479-31addd31ac81 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:28.147986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b9fdd-0e72-4aad-9479-31addd31ac81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:28.148319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b9fdd-0e72-4aad-9479-31addd31ac81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:28.149891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b9fdd-0e72-4aad-9479-31addd31ac81 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:28.161974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1024/2069] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:28:28.166211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd4a4a-4092-415b-bb87-8584d1e0db52 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:28.175895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd4a4a-4092-415b-bb87-8584d1e0db52 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:28.180579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07235be7-45a3-4303-9259-d6b43830e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:28.181222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07235be7-45a3-4303-9259-d6b43830e92a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:28.181505 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07235be7-45a3-4303-9259-d6b43830e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:28.181778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07235be7-45a3-4303-9259-d6b43830e92a admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:28.182461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07235be7-45a3-4303-9259-d6b43830e92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:28.184377 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07235be7-45a3-4303-9259-d6b43830e92a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:28.209867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1046/2070] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:28 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:28.213915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b9fdd-0e72-4aad-9479-31addd31ac81 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:28.224935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b9fdd-0e72-4aad-9479-31addd31ac81 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:28.277642 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a9f85-c8a8-4d66-8ec0-1c358b259fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:28.278276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a9f85-c8a8-4d66-8ec0-1c358b259fff admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:28.278554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a9f85-c8a8-4d66-8ec0-1c358b259fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:28.278826 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a9f85-c8a8-4d66-8ec0-1c358b259fff admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:28.279516 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a9f85-c8a8-4d66-8ec0-1c358b259fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:28.282158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a9f85-c8a8-4d66-8ec0-1c358b259fff admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:28.302033 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1025/2071] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:28 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:28.306117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07235be7-45a3-4303-9259-d6b43830e92a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:28.316933 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07235be7-45a3-4303-9259-d6b43830e92a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:28.321461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaaaa7-f9c9-429d-8739-113358e509a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:28.322107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaaaa7-f9c9-429d-8739-113358e509a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:28.322387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaaaa7-f9c9-429d-8739-113358e509a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:28.322658 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaaaa7-f9c9-429d-8739-113358e509a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:28.323368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaaaaa7-f9c9-429d-8739-113358e509a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:28.324971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaaaaa7-f9c9-429d-8739-113358e509a3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:28.335630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1047/2072] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:28.339498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a9f85-c8a8-4d66-8ec0-1c358b259fff admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:28.349822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a9f85-c8a8-4d66-8ec0-1c358b259fff admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:28.354351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af43f5d-4012-4d96-b2bf-90fe02be9ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:28.354998 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af43f5d-4012-4d96-b2bf-90fe02be9ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:28.355278 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af43f5d-4012-4d96-b2bf-90fe02be9ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:28.355553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af43f5d-4012-4d96-b2bf-90fe02be9ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:28.356304 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af43f5d-4012-4d96-b2bf-90fe02be9ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:28.357887 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af43f5d-4012-4d96-b2bf-90fe02be9ea2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:28.367864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1026/2073] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:28.371680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaaaa7-f9c9-429d-8739-113358e509a3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:28.381289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaaaa7-f9c9-429d-8739-113358e509a3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:28.385859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38c748-f9d5-4adf-a6c1-798633657f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:28.386750 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38c748-f9d5-4adf-a6c1-798633657f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:28.387027 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38c748-f9d5-4adf-a6c1-798633657f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:28.387300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38c748-f9d5-4adf-a6c1-798633657f8e admin admin] PATH_INFO: `/v3/projects/80a52c36a6c449d4abe954b1ed253c05/users/930a0f7511be4af3976cccfd1002b9f6/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:28.403325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38c748-f9d5-4adf-a6c1-798633657f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a52c36a6c449d4abe954b1ed253c05, user_id=930a0f7511be4af3976cccfd1002b9f6, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:28.406878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38c748-f9d5-4adf-a6c1-798633657f8e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:28.420431 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1048/2074] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:28 2022] PUT /identity/v3/projects/80a52c36a6c449d4abe954b1ed253c05/users/930a0f7511be4af3976cccfd1002b9f6/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:28.431993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ac2a-c642-4315-8a9c-b7a70f1c5dad None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:28.432315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ac2a-c642-4315-8a9c-b7a70f1c5dad None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:28.432593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ac2a-c642-4315-8a9c-b7a70f1c5dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:28.458820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-fe68ac2a-c642-4315-8a9c-b7a70f1c5dad None None] MFA Rules not processed for user `930a0f7511be4af3976cccfd1002b9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:28.460046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-fe68ac2a-c642-4315-8a9c-b7a70f1c5dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:28.522465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1027/2075] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:28.533292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38c748-f9d5-4adf-a6c1-798633657f8e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:28.535060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3b38c748-f9d5-4adf-a6c1-798633657f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:28.595285 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38c748-f9d5-4adf-a6c1-798633657f8e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:28.599063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4795160-8d45-4ad3-8d72-c07942a9060a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:28.599807 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4795160-8d45-4ad3-8d72-c07942a9060a service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:28.600246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4795160-8d45-4ad3-8d72-c07942a9060a service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:28.600529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4795160-8d45-4ad3-8d72-c07942a9060a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:28.609333 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4795160-8d45-4ad3-8d72-c07942a9060a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:28.610771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4795160-8d45-4ad3-8d72-c07942a9060a service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:28.619521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1049/2076] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:28.639412 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68ac2a-c642-4315-8a9c-b7a70f1c5dad None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:28.701221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68ac2a-c642-4315-8a9c-b7a70f1c5dad None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:28.706874 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:28.707733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:28.708018 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:28.708434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] PATH_INFO: `/v3/users/930a0f7511be4af3976cccfd1002b9f6` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:28.709637 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=930a0f7511be4af3976cccfd1002b9f6)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:28.711548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:28.770788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930a0f7511be4af3976cccfd1002b9f6'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:28.783084 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930a0f7511be4af3976cccfd1002b9f6'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:28.790788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930a0f7511be4af3976cccfd1002b9f6'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:28.797813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930a0f7511be4af3976cccfd1002b9f6'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:28.798491 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930a0f7511be4af3976cccfd1002b9f6'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:28.804539 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1028/2077] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:28 2022] DELETE /identity/v3/users/930a0f7511be4af3976cccfd1002b9f6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:28.808934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecca74-b305-4b24-a345-84af4b295e3d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:28.809219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecca74-b305-4b24-a345-84af4b295e3d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:28.809501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecca74-b305-4b24-a345-84af4b295e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:28.851280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d5ecca74-b305-4b24-a345-84af4b295e3d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:28.851280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d5ecca74-b305-4b24-a345-84af4b295e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:28.914438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1050/2078] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:28.924511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:28.926190 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:28.995983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8a644-a159-48cf-952c-77c40838ed49 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:29.000617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cee3f7-cca3-423f-8555-2a8238ef0eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:29.001570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cee3f7-cca3-423f-8555-2a8238ef0eee service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:29.001954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cee3f7-cca3-423f-8555-2a8238ef0eee service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:29.002328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cee3f7-cca3-423f-8555-2a8238ef0eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:29.012689 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cee3f7-cca3-423f-8555-2a8238ef0eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:29.014565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cee3f7-cca3-423f-8555-2a8238ef0eee service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:29.035106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1029/2079] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:29.313749 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecca74-b305-4b24-a345-84af4b295e3d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:29.315722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d5ecca74-b305-4b24-a345-84af4b295e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:29.329739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecca74-b305-4b24-a345-84af4b295e3d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:29.334797 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:29.335662 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:29.335944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:29.336264 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd admin admin] PATH_INFO: `/v3/projects/80a52c36a6c449d4abe954b1ed253c05` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:29.337717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a52c36a6c449d4abe954b1ed253c05)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:29.341708 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:29.393131 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a52c36a6c449d4abe954b1ed253c05', 'request_id': 'req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:29.399952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a52c36a6c449d4abe954b1ed253c05', 'request_id': 'req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:29.409213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a52c36a6c449d4abe954b1ed253c05', 'request_id': 'req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:29.425905 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd admin admin] The token cache is being invalidate because project 80a52c36a6c449d4abe954b1ed253c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:29.426194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:29.426819 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a67b5c8d-dc34-4d96-a6fb-2666a9acb0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:29.428373 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1051/2080] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:29 2022] DELETE /identity/v3/projects/80a52c36a6c449d4abe954b1ed253c05 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:29.434611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd8b73-7ceb-4341-863e-0e99c9fe9aa0 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:29.435097 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd8b73-7ceb-4341-863e-0e99c9fe9aa0 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:29.435466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd8b73-7ceb-4341-863e-0e99c9fe9aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:29.460217 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-cbdd8b73-7ceb-4341-863e-0e99c9fe9aa0 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:29.461519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-cbdd8b73-7ceb-4341-863e-0e99c9fe9aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:29.539378 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1030/2081] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:29.548145 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb256f-559b-4cb0-98d8-b6701e2c7f5b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:29.548513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb256f-559b-4cb0-98d8-b6701e2c7f5b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:29.548852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb256f-559b-4cb0-98d8-b6701e2c7f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:29.571739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-35fb256f-559b-4cb0-98d8-b6701e2c7f5b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:29.573087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-35fb256f-559b-4cb0-98d8-b6701e2c7f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:29.586714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1052/2082] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:29.591673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd8b73-7ceb-4341-863e-0e99c9fe9aa0 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:29.602720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd8b73-7ceb-4341-863e-0e99c9fe9aa0 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:29.607695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed2aad-38aa-44e9-a63f-2359ddfce99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:29.609117 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2aad-38aa-44e9-a63f-2359ddfce99d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:29.609530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2aad-38aa-44e9-a63f-2359ddfce99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:29.609839 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2aad-38aa-44e9-a63f-2359ddfce99d admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:29.610578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed2aad-38aa-44e9-a63f-2359ddfce99d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:29.610887 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed2aad-38aa-44e9-a63f-2359ddfce99d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:29.612527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed2aad-38aa-44e9-a63f-2359ddfce99d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:29.629155 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1031/2083] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:28:29.633568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb256f-559b-4cb0-98d8-b6701e2c7f5b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:29.643127 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb256f-559b-4cb0-98d8-b6701e2c7f5b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:29.648002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c55f1-8f9a-4e2e-a555-35b3df7c8c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:29.648619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c55f1-8f9a-4e2e-a555-35b3df7c8c43 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:29.648902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c55f1-8f9a-4e2e-a555-35b3df7c8c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:29.649176 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c55f1-8f9a-4e2e-a555-35b3df7c8c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:29.649991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c55f1-8f9a-4e2e-a555-35b3df7c8c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:29.652208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c55f1-8f9a-4e2e-a555-35b3df7c8c43 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:29.681528 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1053/2084] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:29 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:29.686636 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed2aad-38aa-44e9-a63f-2359ddfce99d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:29.698580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed2aad-38aa-44e9-a63f-2359ddfce99d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:29.764310 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429565c-bdf3-4285-b0b7-bfee22f82404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:29.765822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429565c-bdf3-4285-b0b7-bfee22f82404 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:29.766294 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429565c-bdf3-4285-b0b7-bfee22f82404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:29.766778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429565c-bdf3-4285-b0b7-bfee22f82404 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:29.767925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429565c-bdf3-4285-b0b7-bfee22f82404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:29.771339 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429565c-bdf3-4285-b0b7-bfee22f82404 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:29.796369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1032/2085] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:29 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:29.799984 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c55f1-8f9a-4e2e-a555-35b3df7c8c43 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:29.815523 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c55f1-8f9a-4e2e-a555-35b3df7c8c43 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:29.820469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18529-a5e9-4e4f-b513-5b33fc9dabd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:29.821140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18529-a5e9-4e4f-b513-5b33fc9dabd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:29.821423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18529-a5e9-4e4f-b513-5b33fc9dabd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:29.821696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18529-a5e9-4e4f-b513-5b33fc9dabd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:29.822421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d18529-a5e9-4e4f-b513-5b33fc9dabd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:29.824666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d18529-a5e9-4e4f-b513-5b33fc9dabd6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:29.839205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1054/2086] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:28:29.844059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429565c-bdf3-4285-b0b7-bfee22f82404 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:29.854591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429565c-bdf3-4285-b0b7-bfee22f82404 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:29.859752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd786a-94bc-4e57-8e5b-5c7f2befae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:29.861152 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd786a-94bc-4e57-8e5b-5c7f2befae6a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:29.861152 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd786a-94bc-4e57-8e5b-5c7f2befae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:29.861152 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd786a-94bc-4e57-8e5b-5c7f2befae6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:29.861737 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd786a-94bc-4e57-8e5b-5c7f2befae6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:29.863341 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd786a-94bc-4e57-8e5b-5c7f2befae6a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:29.875105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1033/2087] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:29.878732 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18529-a5e9-4e4f-b513-5b33fc9dabd6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:29.891410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18529-a5e9-4e4f-b513-5b33fc9dabd6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:29.897091 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb0e1f-63e7-497b-823d-e76ff5a5aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:29.898188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb0e1f-63e7-497b-823d-e76ff5a5aff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:29.898350 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb0e1f-63e7-497b-823d-e76ff5a5aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:29.898616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb0e1f-63e7-497b-823d-e76ff5a5aff4 admin admin] PATH_INFO: `/v3/projects/427dfbc4771d4c969275c7de4eda7f93/users/30a3ae3957ec4603a5724300ab7a1290/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:29.914743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb0e1f-63e7-497b-823d-e76ff5a5aff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=427dfbc4771d4c969275c7de4eda7f93, user_id=30a3ae3957ec4603a5724300ab7a1290, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:29.917473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb0e1f-63e7-497b-823d-e76ff5a5aff4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:29.931651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1055/2088] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:29 2022] PUT /identity/v3/projects/427dfbc4771d4c969275c7de4eda7f93/users/30a3ae3957ec4603a5724300ab7a1290/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:29.943532 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fd0ce-1e3e-41e5-8d29-43db0020592e None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:29.943844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fd0ce-1e3e-41e5-8d29-43db0020592e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:29.944243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fd0ce-1e3e-41e5-8d29-43db0020592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:29.981303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-c40fd0ce-1e3e-41e5-8d29-43db0020592e None None] MFA Rules not processed for user `30a3ae3957ec4603a5724300ab7a1290`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:29.983423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c40fd0ce-1e3e-41e5-8d29-43db0020592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:30.068665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1034/2089] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:30.077994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb0e1f-63e7-497b-823d-e76ff5a5aff4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:30.079625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-62cb0e1f-63e7-497b-823d-e76ff5a5aff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:30.141795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb0e1f-63e7-497b-823d-e76ff5a5aff4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:30.145677 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dc284-8041-4753-b6cf-daa812b81d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:30.146328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dc284-8041-4753-b6cf-daa812b81d2f service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:30.146611 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dc284-8041-4753-b6cf-daa812b81d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:30.146886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dc284-8041-4753-b6cf-daa812b81d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:30.156945 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24dc284-8041-4753-b6cf-daa812b81d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:30.158322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24dc284-8041-4753-b6cf-daa812b81d2f service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:30.169806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1056/2090] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:28:32.589989 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fd0ce-1e3e-41e5-8d29-43db0020592e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:32.592257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c40fd0ce-1e3e-41e5-8d29-43db0020592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:32.664257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fd0ce-1e3e-41e5-8d29-43db0020592e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:32.669658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:32.670527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:32.670878 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:32.671904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] PATH_INFO: `/v3/users/53e861d3168e437db8b343fad7779c9c` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:32.673277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e861d3168e437db8b343fad7779c9c)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:32.675306 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:32.728871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e861d3168e437db8b343fad7779c9c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:32.740357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e861d3168e437db8b343fad7779c9c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:32.747650 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e861d3168e437db8b343fad7779c9c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:32.754940 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e861d3168e437db8b343fad7779c9c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:32.755569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e861d3168e437db8b343fad7779c9c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:32.761259 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1035/2091] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:32 2022] DELETE /identity/v3/users/53e861d3168e437db8b343fad7779c9c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:32.766267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49458535-9272-45a7-9e42-2a228da4b5cb None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:32.766800 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49458535-9272-45a7-9e42-2a228da4b5cb None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:32.766891 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49458535-9272-45a7-9e42-2a228da4b5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:32.784917 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-49458535-9272-45a7-9e42-2a228da4b5cb None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:32.786099 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-49458535-9272-45a7-9e42-2a228da4b5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:32.842261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1057/2092] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:32.852694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:32.854119 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:32.911875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca498e-0e92-49c0-99c7-b69307fe84fa admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:32.915548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903d238-0073-4121-a7a5-99de1735531b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:32.916219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903d238-0073-4121-a7a5-99de1735531b service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:32.916504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903d238-0073-4121-a7a5-99de1735531b service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:32.916782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903d238-0073-4121-a7a5-99de1735531b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:32.926565 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903d238-0073-4121-a7a5-99de1735531b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:32.928004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903d238-0073-4121-a7a5-99de1735531b service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:32.937461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1036/2093] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:33.189640 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49458535-9272-45a7-9e42-2a228da4b5cb None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:33.191036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-49458535-9272-45a7-9e42-2a228da4b5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:33.204400 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49458535-9272-45a7-9e42-2a228da4b5cb None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:33.209073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:33.209943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:33.210221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:33.210492 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] PATH_INFO: `/v3/projects/d36c86643cdd44738c3b9f28face9784` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:33.211665 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36c86643cdd44738c3b9f28face9784)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:33.213583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:33.261370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36c86643cdd44738c3b9f28face9784', 'request_id': 'req-2f367997-1faf-4c84-99d1-ad96816db69d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.267494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36c86643cdd44738c3b9f28face9784', 'request_id': 'req-2f367997-1faf-4c84-99d1-ad96816db69d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.273694 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36c86643cdd44738c3b9f28face9784', 'request_id': 'req-2f367997-1faf-4c84-99d1-ad96816db69d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.286505 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] The token cache is being invalidate because project d36c86643cdd44738c3b9f28face9784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:33.286792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.287414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.289026 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1058/2094] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:33 2022] DELETE /identity/v3/projects/d36c86643cdd44738c3b9f28face9784 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:33.293011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903d238-0073-4121-a7a5-99de1735531b service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:33.303412 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903d238-0073-4121-a7a5-99de1735531b service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:33.357194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40889a7e-b086-43f0-8a4a-12fb0ec65700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:33.358052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40889a7e-b086-43f0-8a4a-12fb0ec65700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:33.358362 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40889a7e-b086-43f0-8a4a-12fb0ec65700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:33.358636 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40889a7e-b086-43f0-8a4a-12fb0ec65700 admin admin] PATH_INFO: `/v3/users/975be93aecc745d1bdfe3a576eab2d93` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:33.359874 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40889a7e-b086-43f0-8a4a-12fb0ec65700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=975be93aecc745d1bdfe3a576eab2d93)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:33.361782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40889a7e-b086-43f0-8a4a-12fb0ec65700 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:33.406685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-40889a7e-b086-43f0-8a4a-12fb0ec65700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975be93aecc745d1bdfe3a576eab2d93'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.418817 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-40889a7e-b086-43f0-8a4a-12fb0ec65700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975be93aecc745d1bdfe3a576eab2d93'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.425796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-40889a7e-b086-43f0-8a4a-12fb0ec65700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975be93aecc745d1bdfe3a576eab2d93'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.432279 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-40889a7e-b086-43f0-8a4a-12fb0ec65700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975be93aecc745d1bdfe3a576eab2d93'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.432894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-40889a7e-b086-43f0-8a4a-12fb0ec65700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975be93aecc745d1bdfe3a576eab2d93'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.440666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1037/2095] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:33 2022] DELETE /identity/v3/users/975be93aecc745d1bdfe3a576eab2d93 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:33.714060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:33.715596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:33.729471 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f367997-1faf-4c84-99d1-ad96816db69d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:33.799778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56588b-b972-4a69-b355-3073c27f26cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:33.800805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56588b-b972-4a69-b355-3073c27f26cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:33.800987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56588b-b972-4a69-b355-3073c27f26cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:33.801245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56588b-b972-4a69-b355-3073c27f26cb admin admin] PATH_INFO: `/v3/projects/339b2fcdcb0f400ab13bd017800cd305` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:33.803829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56588b-b972-4a69-b355-3073c27f26cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=339b2fcdcb0f400ab13bd017800cd305)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:33.804586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56588b-b972-4a69-b355-3073c27f26cb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:33.853912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4f56588b-b972-4a69-b355-3073c27f26cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339b2fcdcb0f400ab13bd017800cd305', 'request_id': 'req-4f56588b-b972-4a69-b355-3073c27f26cb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.859899 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4f56588b-b972-4a69-b355-3073c27f26cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339b2fcdcb0f400ab13bd017800cd305', 'request_id': 'req-4f56588b-b972-4a69-b355-3073c27f26cb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.866577 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4f56588b-b972-4a69-b355-3073c27f26cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339b2fcdcb0f400ab13bd017800cd305', 'request_id': 'req-4f56588b-b972-4a69-b355-3073c27f26cb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.884136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4f56588b-b972-4a69-b355-3073c27f26cb admin admin] The token cache is being invalidate because project 339b2fcdcb0f400ab13bd017800cd305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:33.884464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4f56588b-b972-4a69-b355-3073c27f26cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.896383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4f56588b-b972-4a69-b355-3073c27f26cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:33.898135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1059/2096] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:33 2022] DELETE /identity/v3/projects/339b2fcdcb0f400ab13bd017800cd305 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:33.903500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886a2f0-95d5-446d-8c97-f076481cfe9b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:33.904013 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886a2f0-95d5-446d-8c97-f076481cfe9b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:33.904271 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886a2f0-95d5-446d-8c97-f076481cfe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:33.922923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0886a2f0-95d5-446d-8c97-f076481cfe9b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:33.924258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0886a2f0-95d5-446d-8c97-f076481cfe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:33.985269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1038/2097] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:33.994300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271a78-4ffa-49fb-8ca0-c633c168e704 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:33.994593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271a78-4ffa-49fb-8ca0-c633c168e704 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:33.994875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271a78-4ffa-49fb-8ca0-c633c168e704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.013727 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-85271a78-4ffa-49fb-8ca0-c633c168e704 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:34.015751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-85271a78-4ffa-49fb-8ca0-c633c168e704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:34.024190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1060/2098] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:34.028990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886a2f0-95d5-446d-8c97-f076481cfe9b None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.038897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886a2f0-95d5-446d-8c97-f076481cfe9b None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:34.043647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904dee8-e41e-432a-8538-654b3e13efa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:34.044340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904dee8-e41e-432a-8538-654b3e13efa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.044619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904dee8-e41e-432a-8538-654b3e13efa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.044896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904dee8-e41e-432a-8538-654b3e13efa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.045615 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904dee8-e41e-432a-8538-654b3e13efa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:34.045972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904dee8-e41e-432a-8538-654b3e13efa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:34.047563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904dee8-e41e-432a-8538-654b3e13efa3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:34.058935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1039/2099] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:28:34.063999 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85271a78-4ffa-49fb-8ca0-c633c168e704 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.072929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85271a78-4ffa-49fb-8ca0-c633c168e704 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:34.078637 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c758634-dcf9-4497-9af7-566085e47859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:34.079268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c758634-dcf9-4497-9af7-566085e47859 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.079546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c758634-dcf9-4497-9af7-566085e47859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.079814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c758634-dcf9-4497-9af7-566085e47859 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.080526 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c758634-dcf9-4497-9af7-566085e47859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:34.082411 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c758634-dcf9-4497-9af7-566085e47859 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:34.107442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1061/2100] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:34 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:34.111817 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904dee8-e41e-432a-8538-654b3e13efa3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.121703 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904dee8-e41e-432a-8538-654b3e13efa3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:34.179244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6511a7-3dab-4a9a-868e-c25ded1b76be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:34.179905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6511a7-3dab-4a9a-868e-c25ded1b76be admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.180220 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6511a7-3dab-4a9a-868e-c25ded1b76be admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.180498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6511a7-3dab-4a9a-868e-c25ded1b76be admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.181189 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6511a7-3dab-4a9a-868e-c25ded1b76be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:34.183099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6511a7-3dab-4a9a-868e-c25ded1b76be admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:34.203629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1040/2101] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:34 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:34.208260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c758634-dcf9-4497-9af7-566085e47859 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.218835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c758634-dcf9-4497-9af7-566085e47859 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:34.223441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758695b-a3b0-4c18-82a1-bdf636bcc2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:34.224121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758695b-a3b0-4c18-82a1-bdf636bcc2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.224402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758695b-a3b0-4c18-82a1-bdf636bcc2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.224681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758695b-a3b0-4c18-82a1-bdf636bcc2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.225405 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758695b-a3b0-4c18-82a1-bdf636bcc2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:34.226996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758695b-a3b0-4c18-82a1-bdf636bcc2a5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:34.238914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1062/2102] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:34.242885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6511a7-3dab-4a9a-868e-c25ded1b76be admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.253394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6511a7-3dab-4a9a-868e-c25ded1b76be admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:34.259919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b56b3-183d-4d6e-869f-3717ec96efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:34.260640 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b56b3-183d-4d6e-869f-3717ec96efbf admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.260917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b56b3-183d-4d6e-869f-3717ec96efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.261210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b56b3-183d-4d6e-869f-3717ec96efbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.261943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b56b3-183d-4d6e-869f-3717ec96efbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:34.263563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b56b3-183d-4d6e-869f-3717ec96efbf admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:34.275480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1041/2103] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:34.279936 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758695b-a3b0-4c18-82a1-bdf636bcc2a5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.289686 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758695b-a3b0-4c18-82a1-bdf636bcc2a5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:34.294233 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d8fb2-03ce-4ef7-9f06-5d4f78c6985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:34.295090 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d8fb2-03ce-4ef7-9f06-5d4f78c6985f admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.295368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d8fb2-03ce-4ef7-9f06-5d4f78c6985f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.295637 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d8fb2-03ce-4ef7-9f06-5d4f78c6985f admin admin] PATH_INFO: `/v3/projects/0ea1735574bb4174bfb102cfe5e05dce/users/53d57ab8376f4639a1e7e5e16552b251/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.310960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d8fb2-03ce-4ef7-9f06-5d4f78c6985f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ea1735574bb4174bfb102cfe5e05dce, user_id=53d57ab8376f4639a1e7e5e16552b251, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:34.314229 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d8fb2-03ce-4ef7-9f06-5d4f78c6985f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:34.327571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1063/2104] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:34 2022] PUT /identity/v3/projects/0ea1735574bb4174bfb102cfe5e05dce/users/53d57ab8376f4639a1e7e5e16552b251/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:34.337811 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb966c-9689-4c89-bb7c-fc93d663e24a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.338099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb966c-9689-4c89-bb7c-fc93d663e24a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.338369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb966c-9689-4c89-bb7c-fc93d663e24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.365446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-49eb966c-9689-4c89-bb7c-fc93d663e24a None None] MFA Rules not processed for user `53d57ab8376f4639a1e7e5e16552b251`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:34.366653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-49eb966c-9689-4c89-bb7c-fc93d663e24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:34.433089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1042/2105] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:34.438286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d8fb2-03ce-4ef7-9f06-5d4f78c6985f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.499967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d8fb2-03ce-4ef7-9f06-5d4f78c6985f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:34.504650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb0d20-e4bc-4bfa-ac5a-180c98e5dc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:34.505904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb0d20-e4bc-4bfa-ac5a-180c98e5dc48 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.506190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb0d20-e4bc-4bfa-ac5a-180c98e5dc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.506485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb0d20-e4bc-4bfa-ac5a-180c98e5dc48 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.507187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb0d20-e4bc-4bfa-ac5a-180c98e5dc48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:34.509137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb0d20-e4bc-4bfa-ac5a-180c98e5dc48 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:34.540281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1064/2106] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:34 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:34.544490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb966c-9689-4c89-bb7c-fc93d663e24a None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.555791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb966c-9689-4c89-bb7c-fc93d663e24a None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:34.612730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd2e9a-8350-4ac7-8546-0f155a1811e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:34.613394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd2e9a-8350-4ac7-8546-0f155a1811e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.613667 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd2e9a-8350-4ac7-8546-0f155a1811e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.613937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd2e9a-8350-4ac7-8546-0f155a1811e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.614619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd2e9a-8350-4ac7-8546-0f155a1811e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:34.616548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd2e9a-8350-4ac7-8546-0f155a1811e7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:34.636500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1043/2107] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:34 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:34.640671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb0d20-e4bc-4bfa-ac5a-180c98e5dc48 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.650718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb0d20-e4bc-4bfa-ac5a-180c98e5dc48 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:34.656184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa4205-dc63-4363-b6b0-864207c7fcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:34.656821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa4205-dc63-4363-b6b0-864207c7fcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.657124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa4205-dc63-4363-b6b0-864207c7fcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.657513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa4205-dc63-4363-b6b0-864207c7fcf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.658247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa4205-dc63-4363-b6b0-864207c7fcf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:34.659844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa4205-dc63-4363-b6b0-864207c7fcf1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:34.670122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1065/2108] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:28:34.674739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd2e9a-8350-4ac7-8546-0f155a1811e7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.684700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd2e9a-8350-4ac7-8546-0f155a1811e7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:34.689438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ef33c-98e6-4836-aa19-2d37f6708e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:34.690309 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ef33c-98e6-4836-aa19-2d37f6708e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.690589 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ef33c-98e6-4836-aa19-2d37f6708e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.690864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ef33c-98e6-4836-aa19-2d37f6708e28 admin admin] PATH_INFO: `/v3/projects/4f9d996d6c2948468680d4cd20b5e702/users/7ac3931417de467284a2860430e3cc9c/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.706852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ef33c-98e6-4836-aa19-2d37f6708e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9d996d6c2948468680d4cd20b5e702, user_id=7ac3931417de467284a2860430e3cc9c, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:34.709607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ef33c-98e6-4836-aa19-2d37f6708e28 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:34.722751 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1044/2109] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:34 2022] PUT /identity/v3/projects/4f9d996d6c2948468680d4cd20b5e702/users/7ac3931417de467284a2860430e3cc9c/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:34.726824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa4205-dc63-4363-b6b0-864207c7fcf1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.737442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa4205-dc63-4363-b6b0-864207c7fcf1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:34.793564 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b803db8-6e99-4add-8f17-64d96dbfc9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:34.794230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b803db8-6e99-4add-8f17-64d96dbfc9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.794514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b803db8-6e99-4add-8f17-64d96dbfc9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.794791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b803db8-6e99-4add-8f17-64d96dbfc9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.795503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b803db8-6e99-4add-8f17-64d96dbfc9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:34.797788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b803db8-6e99-4add-8f17-64d96dbfc9d2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:34.808094 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1066/2110] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:34.812682 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ef33c-98e6-4836-aa19-2d37f6708e28 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.823005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ef33c-98e6-4836-aa19-2d37f6708e28 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:34.827699 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bf8a6-d104-4406-9c57-4ba134638ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:34.828605 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bf8a6-d104-4406-9c57-4ba134638ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.828888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bf8a6-d104-4406-9c57-4ba134638ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.829166 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bf8a6-d104-4406-9c57-4ba134638ec1 admin admin] PATH_INFO: `/v3/projects/4f9d996d6c2948468680d4cd20b5e702/users/7ac3931417de467284a2860430e3cc9c/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.831209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bf8a6-d104-4406-9c57-4ba134638ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9d996d6c2948468680d4cd20b5e702, user_id=7ac3931417de467284a2860430e3cc9c, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:34.833890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bf8a6-d104-4406-9c57-4ba134638ec1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:34.845672 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1045/2111] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:34 2022] PUT /identity/v3/projects/4f9d996d6c2948468680d4cd20b5e702/users/7ac3931417de467284a2860430e3cc9c/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:34.855219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b6e3b-7466-4d8a-85e6-02beb8fcfd46 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:34.855506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b6e3b-7466-4d8a-85e6-02beb8fcfd46 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:34.855783 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b6e3b-7466-4d8a-85e6-02beb8fcfd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:34.882383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-403b6e3b-7466-4d8a-85e6-02beb8fcfd46 None None] MFA Rules not processed for user `7ac3931417de467284a2860430e3cc9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:34.883583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-403b6e3b-7466-4d8a-85e6-02beb8fcfd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:34.951821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1067/2112] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:34.961672 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bf8a6-d104-4406-9c57-4ba134638ec1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:34.963541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f50bf8a6-d104-4406-9c57-4ba134638ec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:35.028625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bf8a6-d104-4406-9c57-4ba134638ec1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:35.035869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67ba9e-dbde-41da-ad5b-d0299f98c3d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:35.036558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67ba9e-dbde-41da-ad5b-d0299f98c3d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:35.036839 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67ba9e-dbde-41da-ad5b-d0299f98c3d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:35.037115 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67ba9e-dbde-41da-ad5b-d0299f98c3d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:35.047198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67ba9e-dbde-41da-ad5b-d0299f98c3d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:35.048668 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67ba9e-dbde-41da-ad5b-d0299f98c3d6 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:35.058446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1046/2113] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:35.153488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b6e3b-7466-4d8a-85e6-02beb8fcfd46 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:35.165935 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b6e3b-7466-4d8a-85e6-02beb8fcfd46 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:35.170074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba1269-cb4f-4c1c-894b-e02eb7cfca30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:35.170779 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba1269-cb4f-4c1c-894b-e02eb7cfca30 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:35.171075 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba1269-cb4f-4c1c-894b-e02eb7cfca30 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:35.171346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba1269-cb4f-4c1c-894b-e02eb7cfca30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:35.227064 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba1269-cb4f-4c1c-894b-e02eb7cfca30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:35.228436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba1269-cb4f-4c1c-894b-e02eb7cfca30 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:35.237254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1068/2114] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:38.856701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67ba9e-dbde-41da-ad5b-d0299f98c3d6 service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:38.949995 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67ba9e-dbde-41da-ad5b-d0299f98c3d6 service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:38.955486 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:38.956373 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:38.956672 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:38.957079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] PATH_INFO: `/v3/users/53d57ab8376f4639a1e7e5e16552b251` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:38.958539 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d57ab8376f4639a1e7e5e16552b251)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:38.960118 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:39.021960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d57ab8376f4639a1e7e5e16552b251'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.040213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d57ab8376f4639a1e7e5e16552b251'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.062338 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d57ab8376f4639a1e7e5e16552b251'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.075256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d57ab8376f4639a1e7e5e16552b251'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.076625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d57ab8376f4639a1e7e5e16552b251'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.088667 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1047/2115] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:38 2022] DELETE /identity/v3/users/53d57ab8376f4639a1e7e5e16552b251 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:39.089778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0e110-8b18-4159-8f09-2a41df2e5a8c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:39.090250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0e110-8b18-4159-8f09-2a41df2e5a8c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:39.090335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0e110-8b18-4159-8f09-2a41df2e5a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:39.110106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a5b0e110-8b18-4159-8f09-2a41df2e5a8c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:39.111615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a5b0e110-8b18-4159-8f09-2a41df2e5a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:39.179957 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1069/2116] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:39.190982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:39.192444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:39.251888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0e110-8b18-4159-8f09-2a41df2e5a8c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:39.253372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a5b0e110-8b18-4159-8f09-2a41df2e5a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:39.266947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0e110-8b18-4159-8f09-2a41df2e5a8c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:39.276895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:39.277858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:39.278213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:39.278487 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] PATH_INFO: `/v3/users/30a3ae3957ec4603a5724300ab7a1290` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:39.282609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a3ae3957ec4603a5724300ab7a1290)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:39.284285 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:39.289736 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88961971-9250-4b8b-ab8f-fb7279b20cd3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:39.294086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84613db-f3ca-4d5d-9897-ba0ef813d12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:39.294950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84613db-f3ca-4d5d-9897-ba0ef813d12b service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:39.295297 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84613db-f3ca-4d5d-9897-ba0ef813d12b service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:39.295748 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84613db-f3ca-4d5d-9897-ba0ef813d12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:39.305993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84613db-f3ca-4d5d-9897-ba0ef813d12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:39.308079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84613db-f3ca-4d5d-9897-ba0ef813d12b service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:39.321359 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1048/2117] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:39.338905 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a3ae3957ec4603a5724300ab7a1290'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.350626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a3ae3957ec4603a5724300ab7a1290'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.351506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a3ae3957ec4603a5724300ab7a1290'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.360442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a3ae3957ec4603a5724300ab7a1290'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.369527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a3ae3957ec4603a5724300ab7a1290'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.377408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1070/2118] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:39 2022] DELETE /identity/v3/users/30a3ae3957ec4603a5724300ab7a1290 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:39.383014 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64b2f0-7ae1-4fa7-a677-ab8caae9b2a7 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:39.383335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64b2f0-7ae1-4fa7-a677-ab8caae9b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:39.383670 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64b2f0-7ae1-4fa7-a677-ab8caae9b2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:39.415547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-7d64b2f0-7ae1-4fa7-a677-ab8caae9b2a7 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:39.416892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-7d64b2f0-7ae1-4fa7-a677-ab8caae9b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:39.508464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1049/2119] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:39.519926 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:39.521412 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:39.606684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e6d44-b5fe-4582-adbd-976c1058d94a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:39.615065 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76253a-2072-4320-b89e-0e8396488f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:39.615822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76253a-2072-4320-b89e-0e8396488f73 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:39.615977 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76253a-2072-4320-b89e-0e8396488f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:39.616306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76253a-2072-4320-b89e-0e8396488f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:39.631600 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76253a-2072-4320-b89e-0e8396488f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:39.633432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76253a-2072-4320-b89e-0e8396488f73 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:39.642164 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64b2f0-7ae1-4fa7-a677-ab8caae9b2a7 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:39.643626 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-7d64b2f0-7ae1-4fa7-a677-ab8caae9b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:39.644778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1071/2120] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:39.657695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64b2f0-7ae1-4fa7-a677-ab8caae9b2a7 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:39.674701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:39.675486 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:39.675795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:39.676491 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] PATH_INFO: `/v3/projects/0ea1735574bb4174bfb102cfe5e05dce` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:39.677960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ea1735574bb4174bfb102cfe5e05dce)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:39.680369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:39.741287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ea1735574bb4174bfb102cfe5e05dce', 'request_id': 'req-324812f6-81a4-472c-91a0-a677137844d3'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.746742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ea1735574bb4174bfb102cfe5e05dce', 'request_id': 'req-324812f6-81a4-472c-91a0-a677137844d3'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.755647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ea1735574bb4174bfb102cfe5e05dce', 'request_id': 'req-324812f6-81a4-472c-91a0-a677137844d3'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.768153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] The token cache is being invalidate because project 0ea1735574bb4174bfb102cfe5e05dce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:39.769090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.769749 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.772002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1050/2121] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:39 2022] DELETE /identity/v3/projects/0ea1735574bb4174bfb102cfe5e05dce => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:39.775951 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76253a-2072-4320-b89e-0e8396488f73 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:39.785678 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76253a-2072-4320-b89e-0e8396488f73 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:39.854871 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1445ba-827c-4f10-a25a-24b197b5249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:39.856834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1445ba-827c-4f10-a25a-24b197b5249e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:39.857268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1445ba-827c-4f10-a25a-24b197b5249e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:39.857733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1445ba-827c-4f10-a25a-24b197b5249e admin admin] PATH_INFO: `/v3/users/7ac3931417de467284a2860430e3cc9c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:39.861897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1445ba-827c-4f10-a25a-24b197b5249e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac3931417de467284a2860430e3cc9c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:39.864733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1445ba-827c-4f10-a25a-24b197b5249e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:39.919144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-de1445ba-827c-4f10-a25a-24b197b5249e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac3931417de467284a2860430e3cc9c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.931287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:39.932895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:39.934813 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-de1445ba-827c-4f10-a25a-24b197b5249e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac3931417de467284a2860430e3cc9c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.935550 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-de1445ba-827c-4f10-a25a-24b197b5249e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac3931417de467284a2860430e3cc9c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.944215 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-de1445ba-827c-4f10-a25a-24b197b5249e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac3931417de467284a2860430e3cc9c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.948391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324812f6-81a4-472c-91a0-a677137844d3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:39.952145 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-de1445ba-827c-4f10-a25a-24b197b5249e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac3931417de467284a2860430e3cc9c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:39.953697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da473112-bccb-4105-90b0-1db628a0c45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:39.954813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473112-bccb-4105-90b0-1db628a0c45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:39.955113 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473112-bccb-4105-90b0-1db628a0c45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:39.955495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473112-bccb-4105-90b0-1db628a0c45f admin admin] PATH_INFO: `/v3/projects/427dfbc4771d4c969275c7de4eda7f93` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:39.956955 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da473112-bccb-4105-90b0-1db628a0c45f admin admin] RBAC: Authorizing `identity:delete_project(project_id=427dfbc4771d4c969275c7de4eda7f93)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:39.958956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da473112-bccb-4105-90b0-1db628a0c45f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:39.960826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1072/2122] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:39 2022] DELETE /identity/v3/users/7ac3931417de467284a2860430e3cc9c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:40.017873 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-da473112-bccb-4105-90b0-1db628a0c45f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427dfbc4771d4c969275c7de4eda7f93', 'request_id': 'req-da473112-bccb-4105-90b0-1db628a0c45f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:40.023448 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-da473112-bccb-4105-90b0-1db628a0c45f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427dfbc4771d4c969275c7de4eda7f93', 'request_id': 'req-da473112-bccb-4105-90b0-1db628a0c45f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:40.030523 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-da473112-bccb-4105-90b0-1db628a0c45f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427dfbc4771d4c969275c7de4eda7f93', 'request_id': 'req-da473112-bccb-4105-90b0-1db628a0c45f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:40.051030 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-da473112-bccb-4105-90b0-1db628a0c45f admin admin] The token cache is being invalidate because project 427dfbc4771d4c969275c7de4eda7f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:40.051245 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-da473112-bccb-4105-90b0-1db628a0c45f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:40.052066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-da473112-bccb-4105-90b0-1db628a0c45f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:40.054240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1051/2123] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:39 2022] DELETE /identity/v3/projects/427dfbc4771d4c969275c7de4eda7f93 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:40.058926 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ee74a-2840-46ef-b187-7eefb679353e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.059217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ee74a-2840-46ef-b187-7eefb679353e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.059501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ee74a-2840-46ef-b187-7eefb679353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.079827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-532ee74a-2840-46ef-b187-7eefb679353e None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:40.081085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-532ee74a-2840-46ef-b187-7eefb679353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:40.153740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1073/2124] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:40.163698 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbe600-99c3-4f2c-b5b1-bee6a13ce84b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.163988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbe600-99c3-4f2c-b5b1-bee6a13ce84b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.164299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbe600-99c3-4f2c-b5b1-bee6a13ce84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.194855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-58cbe600-99c3-4f2c-b5b1-bee6a13ce84b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:40.195912 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-58cbe600-99c3-4f2c-b5b1-bee6a13ce84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:40.207181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1052/2125] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:40.211591 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ee74a-2840-46ef-b187-7eefb679353e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:40.222751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ee74a-2840-46ef-b187-7eefb679353e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:40.229302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32f857-8d08-4d8a-a3c6-0cc9df18a73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:40.230325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f857-8d08-4d8a-a3c6-0cc9df18a73d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.230772 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f857-8d08-4d8a-a3c6-0cc9df18a73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.231052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f32f857-8d08-4d8a-a3c6-0cc9df18a73d admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.231807 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32f857-8d08-4d8a-a3c6-0cc9df18a73d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:40.232347 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32f857-8d08-4d8a-a3c6-0cc9df18a73d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:40.235142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f32f857-8d08-4d8a-a3c6-0cc9df18a73d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:40.251282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1074/2126] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:28:40.253044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbe600-99c3-4f2c-b5b1-bee6a13ce84b None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:40.265066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbe600-99c3-4f2c-b5b1-bee6a13ce84b None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:40.270619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af12ff3-6927-43d9-b035-492058cd9b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:40.271394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af12ff3-6927-43d9-b035-492058cd9b1d admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.271774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af12ff3-6927-43d9-b035-492058cd9b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.272259 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af12ff3-6927-43d9-b035-492058cd9b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.273046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af12ff3-6927-43d9-b035-492058cd9b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:40.275064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af12ff3-6927-43d9-b035-492058cd9b1d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:40.317170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1053/2127] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:40 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:40.321274 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32f857-8d08-4d8a-a3c6-0cc9df18a73d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:40.335755 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f32f857-8d08-4d8a-a3c6-0cc9df18a73d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:40.392717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af12ff3-6927-43d9-b035-492058cd9b1d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:40.394526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0af12ff3-6927-43d9-b035-492058cd9b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:40.443035 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ffd53-ed56-47e3-a344-0485aa1bdf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:40.443841 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ffd53-ed56-47e3-a344-0485aa1bdf10 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.444237 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ffd53-ed56-47e3-a344-0485aa1bdf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.444594 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ffd53-ed56-47e3-a344-0485aa1bdf10 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.445288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ffd53-ed56-47e3-a344-0485aa1bdf10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:40.447345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ffd53-ed56-47e3-a344-0485aa1bdf10 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:40.471332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1075/2128] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:40 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:40.475668 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ffd53-ed56-47e3-a344-0485aa1bdf10 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:40.485912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ffd53-ed56-47e3-a344-0485aa1bdf10 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:40.487846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af12ff3-6927-43d9-b035-492058cd9b1d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:40.490971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38898e6-fd0c-4171-882f-3b4cb789ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:40.491628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38898e6-fd0c-4171-882f-3b4cb789ccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.491915 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38898e6-fd0c-4171-882f-3b4cb789ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.492239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38898e6-fd0c-4171-882f-3b4cb789ccd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.492937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca139-7181-4183-84f6-45cd56bd60a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:40.493057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38898e6-fd0c-4171-882f-3b4cb789ccd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:40.493976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca139-7181-4183-84f6-45cd56bd60a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.494393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca139-7181-4183-84f6-45cd56bd60a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.494675 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca139-7181-4183-84f6-45cd56bd60a5 admin admin] PATH_INFO: `/v3/projects/4f9d996d6c2948468680d4cd20b5e702` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.494841 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38898e6-fd0c-4171-882f-3b4cb789ccd1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:40.496203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ca139-7181-4183-84f6-45cd56bd60a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f9d996d6c2948468680d4cd20b5e702)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:40.498244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ca139-7181-4183-84f6-45cd56bd60a5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:40.506808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1076/2129] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:28:40.513004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38898e6-fd0c-4171-882f-3b4cb789ccd1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:40.529329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38898e6-fd0c-4171-882f-3b4cb789ccd1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:40.535843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af5dc-6d3d-4d4a-a64b-e2fd1f8f72f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:40.536806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af5dc-6d3d-4d4a-a64b-e2fd1f8f72f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.536931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af5dc-6d3d-4d4a-a64b-e2fd1f8f72f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.537307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300af5dc-6d3d-4d4a-a64b-e2fd1f8f72f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.538105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af5dc-6d3d-4d4a-a64b-e2fd1f8f72f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:40.539718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300af5dc-6d3d-4d4a-a64b-e2fd1f8f72f6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:40.551351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1077/2130] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:40.554541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-eb4ca139-7181-4183-84f6-45cd56bd60a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f9d996d6c2948468680d4cd20b5e702', 'request_id': 'req-eb4ca139-7181-4183-84f6-45cd56bd60a5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:40.556464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af5dc-6d3d-4d4a-a64b-e2fd1f8f72f6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:40.560168 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-eb4ca139-7181-4183-84f6-45cd56bd60a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f9d996d6c2948468680d4cd20b5e702', 'request_id': 'req-eb4ca139-7181-4183-84f6-45cd56bd60a5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:40.566958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-eb4ca139-7181-4183-84f6-45cd56bd60a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f9d996d6c2948468680d4cd20b5e702', 'request_id': 'req-eb4ca139-7181-4183-84f6-45cd56bd60a5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:40.567267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300af5dc-6d3d-4d4a-a64b-e2fd1f8f72f6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:40.580134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-eb4ca139-7181-4183-84f6-45cd56bd60a5 admin admin] The token cache is being invalidate because project 4f9d996d6c2948468680d4cd20b5e702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:40.580435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-eb4ca139-7181-4183-84f6-45cd56bd60a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:40.581083 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-eb4ca139-7181-4183-84f6-45cd56bd60a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:40.582827 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1054/2131] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:40 2022] DELETE /identity/v3/projects/4f9d996d6c2948468680d4cd20b5e702 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:40.587490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e76f7b-b332-48e7-a527-4a1fb53c9016 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.587776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e76f7b-b332-48e7-a527-4a1fb53c9016 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.588115 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e76f7b-b332-48e7-a527-4a1fb53c9016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.607649 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-40e76f7b-b332-48e7-a527-4a1fb53c9016 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:40.609513 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-40e76f7b-b332-48e7-a527-4a1fb53c9016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:40.630051 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1ee07-5c0c-487f-a215-214fd65ece95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:40.631057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1ee07-5c0c-487f-a215-214fd65ece95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.631433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1ee07-5c0c-487f-a215-214fd65ece95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.632008 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1ee07-5c0c-487f-a215-214fd65ece95 admin admin] PATH_INFO: `/v3/projects/690745bb6b6d4a1d8e021f08b9370685/users/e277c102c82b412481a8a9f888f4a7c7/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.647890 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1ee07-5c0c-487f-a215-214fd65ece95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=690745bb6b6d4a1d8e021f08b9370685, user_id=e277c102c82b412481a8a9f888f4a7c7, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:40.650718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1ee07-5c0c-487f-a215-214fd65ece95 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:40.664369 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1078/2132] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:40 2022] PUT /identity/v3/projects/690745bb6b6d4a1d8e021f08b9370685/users/e277c102c82b412481a8a9f888f4a7c7/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:40.669649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2fae-dd70-4e4e-951d-abf8e017a83f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.669945 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2fae-dd70-4e4e-951d-abf8e017a83f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.670240 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2fae-dd70-4e4e-951d-abf8e017a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.680406 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1055/2133] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:40.690400 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-703d2fae-dd70-4e4e-951d-abf8e017a83f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:40.690621 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3037b-4026-47b4-b452-56fcfec641e8 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.690818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3037b-4026-47b4-b452-56fcfec641e8 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.691668 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-703d2fae-dd70-4e4e-951d-abf8e017a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:40.692225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3037b-4026-47b4-b452-56fcfec641e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.717627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-2df3037b-4026-47b4-b452-56fcfec641e8 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:40.719349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2df3037b-4026-47b4-b452-56fcfec641e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:40.757365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1079/2134] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:40.767837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2fae-dd70-4e4e-951d-abf8e017a83f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:40.769297 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-703d2fae-dd70-4e4e-951d-abf8e017a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:40.780423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1056/2135] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:40.784571 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3037b-4026-47b4-b452-56fcfec641e8 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:40.794114 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3037b-4026-47b4-b452-56fcfec641e8 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:40.799338 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbc63a-1e27-4484-bbac-5b2542f42ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:40.799979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbc63a-1e27-4484-bbac-5b2542f42ded admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.800340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbc63a-1e27-4484-bbac-5b2542f42ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.800679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbc63a-1e27-4484-bbac-5b2542f42ded admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.801453 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbc63a-1e27-4484-bbac-5b2542f42ded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:40.801710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbc63a-1e27-4484-bbac-5b2542f42ded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:40.803296 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbc63a-1e27-4484-bbac-5b2542f42ded admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:40.815524 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1057/2136] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:28:40.820298 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbc63a-1e27-4484-bbac-5b2542f42ded admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:40.828177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2fae-dd70-4e4e-951d-abf8e017a83f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:40.830823 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbc63a-1e27-4484-bbac-5b2542f42ded admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:40.831937 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f5715-2bbf-40a8-aacd-8e76eff0e3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:40.832727 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f5715-2bbf-40a8-aacd-8e76eff0e3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.832949 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f5715-2bbf-40a8-aacd-8e76eff0e3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.833217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f5715-2bbf-40a8-aacd-8e76eff0e3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.835697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aadd6-b576-4022-b1b3-22da52c93d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:40.836361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aadd6-b576-4022-b1b3-22da52c93d6b admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.836642 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aadd6-b576-4022-b1b3-22da52c93d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.836916 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aadd6-b576-4022-b1b3-22da52c93d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.837789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525aadd6-b576-4022-b1b3-22da52c93d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:40.839721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525aadd6-b576-4022-b1b3-22da52c93d6b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:40.842258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f5715-2bbf-40a8-aacd-8e76eff0e3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:40.843712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f5715-2bbf-40a8-aacd-8e76eff0e3f4 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:40.853737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1080/2137] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:28:40.867555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1058/2138] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:40 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:40.872184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f5715-2bbf-40a8-aacd-8e76eff0e3f4 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:40.885613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f5715-2bbf-40a8-aacd-8e76eff0e3f4 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:40.943310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21c6fb-9d5f-42ed-9390-c5e2c008fe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:40.943987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21c6fb-9d5f-42ed-9390-c5e2c008fe1e admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.944293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21c6fb-9d5f-42ed-9390-c5e2c008fe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.944578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21c6fb-9d5f-42ed-9390-c5e2c008fe1e admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.945374 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21c6fb-9d5f-42ed-9390-c5e2c008fe1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:40.947487 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21c6fb-9d5f-42ed-9390-c5e2c008fe1e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:40.976497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1081/2139] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:40 2022] POST /identity/v3/users => generated 281 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:40.977776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aadd6-b576-4022-b1b3-22da52c93d6b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:40.989117 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aadd6-b576-4022-b1b3-22da52c93d6b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:40.994071 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e35623-61f8-4e52-a991-ef85fa9d2d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:40.994752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e35623-61f8-4e52-a991-ef85fa9d2d78 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:40.995031 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e35623-61f8-4e52-a991-ef85fa9d2d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:40.995305 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e35623-61f8-4e52-a991-ef85fa9d2d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:40.996183 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e35623-61f8-4e52-a991-ef85fa9d2d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:40.997862 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e35623-61f8-4e52-a991-ef85fa9d2d78 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:41.010460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1059/2140] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:41.016613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21c6fb-9d5f-42ed-9390-c5e2c008fe1e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:41.031277 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21c6fb-9d5f-42ed-9390-c5e2c008fe1e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:41.039417 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570117a1-7df5-4376-937e-1ece63fdbe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:41.040453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570117a1-7df5-4376-937e-1ece63fdbe85 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:41.040898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570117a1-7df5-4376-937e-1ece63fdbe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:41.041304 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570117a1-7df5-4376-937e-1ece63fdbe85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:41.042520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570117a1-7df5-4376-937e-1ece63fdbe85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:41.045135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570117a1-7df5-4376-937e-1ece63fdbe85 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:41.057078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1082/2141] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:41.061160 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e35623-61f8-4e52-a991-ef85fa9d2d78 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:41.072355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e35623-61f8-4e52-a991-ef85fa9d2d78 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:41.077129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9261e43-8182-4fdf-b1c8-e40b7974c0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:41.078006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9261e43-8182-4fdf-b1c8-e40b7974c0db admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:41.078284 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9261e43-8182-4fdf-b1c8-e40b7974c0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:41.078556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9261e43-8182-4fdf-b1c8-e40b7974c0db admin admin] PATH_INFO: `/v3/projects/625af568561f4c2bb2f476d00a8f1570/users/d3573a4ac4c14d22aad08a1016d85ede/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:41.094561 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9261e43-8182-4fdf-b1c8-e40b7974c0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=625af568561f4c2bb2f476d00a8f1570, user_id=d3573a4ac4c14d22aad08a1016d85ede, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:41.098103 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9261e43-8182-4fdf-b1c8-e40b7974c0db admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:41.115134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1060/2142] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:41 2022] PUT /identity/v3/projects/625af568561f4c2bb2f476d00a8f1570/users/d3573a4ac4c14d22aad08a1016d85ede/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:41.126323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b256-3108-4c63-9b67-b4a49fcd9843 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:41.126674 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b256-3108-4c63-9b67-b4a49fcd9843 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:41.127081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b256-3108-4c63-9b67-b4a49fcd9843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:41.156924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c1e5b256-3108-4c63-9b67-b4a49fcd9843 None None] MFA Rules not processed for user `d3573a4ac4c14d22aad08a1016d85ede`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:41.158854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c1e5b256-3108-4c63-9b67-b4a49fcd9843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:41.240134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1083/2143] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:41.270437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9261e43-8182-4fdf-b1c8-e40b7974c0db admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:41.272587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d9261e43-8182-4fdf-b1c8-e40b7974c0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:41.331850 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9261e43-8182-4fdf-b1c8-e40b7974c0db admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:41.335725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244321c-0a76-4c9c-ab65-62e9adf9c10e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:41.336402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244321c-0a76-4c9c-ab65-62e9adf9c10e service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:41.336687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244321c-0a76-4c9c-ab65-62e9adf9c10e service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:41.336964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244321c-0a76-4c9c-ab65-62e9adf9c10e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:41.350405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244321c-0a76-4c9c-ab65-62e9adf9c10e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:41.351894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244321c-0a76-4c9c-ab65-62e9adf9c10e service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:41.367979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1061/2144] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:41.388145 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b256-3108-4c63-9b67-b4a49fcd9843 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:41.462947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b256-3108-4c63-9b67-b4a49fcd9843 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:41.468255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:41.469300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:41.469585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:41.469859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] PATH_INFO: `/v3/users/d3573a4ac4c14d22aad08a1016d85ede` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:41.471343 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3573a4ac4c14d22aad08a1016d85ede)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:41.473294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:41.529538 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3573a4ac4c14d22aad08a1016d85ede'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:41.547766 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3573a4ac4c14d22aad08a1016d85ede'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:41.548678 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3573a4ac4c14d22aad08a1016d85ede'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:41.559218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3573a4ac4c14d22aad08a1016d85ede'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:41.568369 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3573a4ac4c14d22aad08a1016d85ede'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:41.578309 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1084/2145] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:41 2022] DELETE /identity/v3/users/d3573a4ac4c14d22aad08a1016d85ede => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:41.581220 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52483331-2ae5-40b1-856a-9d4a467bba3f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:41.581740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52483331-2ae5-40b1-856a-9d4a467bba3f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:41.582355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52483331-2ae5-40b1-856a-9d4a467bba3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:41.611612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-52483331-2ae5-40b1-856a-9d4a467bba3f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:41.613150 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-52483331-2ae5-40b1-856a-9d4a467bba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:41.728227 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1062/2146] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:41.744275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:41.746074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:41.819331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d806dc-d9f5-4ecc-90e6-28133027b264 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:41.830995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59dc64-53e1-4d28-9113-666ec7b54074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:41.831660 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59dc64-53e1-4d28-9113-666ec7b54074 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:41.831937 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59dc64-53e1-4d28-9113-666ec7b54074 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:41.832236 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59dc64-53e1-4d28-9113-666ec7b54074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:41.851857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59dc64-53e1-4d28-9113-666ec7b54074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:41.853534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59dc64-53e1-4d28-9113-666ec7b54074 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:41.869019 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1085/2147] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:42.624988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52483331-2ae5-40b1-856a-9d4a467bba3f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:42.626938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-52483331-2ae5-40b1-856a-9d4a467bba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:42.664460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52483331-2ae5-40b1-856a-9d4a467bba3f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:42.679699 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88201813-5c56-4bb0-b657-3616d32812d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:42.688340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88201813-5c56-4bb0-b657-3616d32812d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:42.688801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88201813-5c56-4bb0-b657-3616d32812d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:42.689289 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88201813-5c56-4bb0-b657-3616d32812d4 admin admin] PATH_INFO: `/v3/users/bc791ed3513e4bc39bfbe6711147ea59` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:42.690887 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88201813-5c56-4bb0-b657-3616d32812d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc791ed3513e4bc39bfbe6711147ea59)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:42.695837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88201813-5c56-4bb0-b657-3616d32812d4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:42.745335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59dc64-53e1-4d28-9113-666ec7b54074 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:42.747610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3a59dc64-53e1-4d28-9113-666ec7b54074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:42.796527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59dc64-53e1-4d28-9113-666ec7b54074 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:42.810581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390159d-45a7-4e59-bf25-550159e1c1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:42.811147 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88201813-5c56-4bb0-b657-3616d32812d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc791ed3513e4bc39bfbe6711147ea59'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:42.812752 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390159d-45a7-4e59-bf25-550159e1c1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:42.813473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390159d-45a7-4e59-bf25-550159e1c1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:42.813690 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390159d-45a7-4e59-bf25-550159e1c1a6 admin admin] PATH_INFO: `/v3/projects/625af568561f4c2bb2f476d00a8f1570` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:42.815806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390159d-45a7-4e59-bf25-550159e1c1a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=625af568561f4c2bb2f476d00a8f1570)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:42.818100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390159d-45a7-4e59-bf25-550159e1c1a6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:42.860568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88201813-5c56-4bb0-b657-3616d32812d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc791ed3513e4bc39bfbe6711147ea59'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:42.872004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88201813-5c56-4bb0-b657-3616d32812d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc791ed3513e4bc39bfbe6711147ea59'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:42.886829 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88201813-5c56-4bb0-b657-3616d32812d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc791ed3513e4bc39bfbe6711147ea59'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:42.887614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-88201813-5c56-4bb0-b657-3616d32812d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc791ed3513e4bc39bfbe6711147ea59'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:42.893714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1390159d-45a7-4e59-bf25-550159e1c1a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625af568561f4c2bb2f476d00a8f1570', 'request_id': 'req-1390159d-45a7-4e59-bf25-550159e1c1a6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:42.894877 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1063/2148] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:42 2022] DELETE /identity/v3/users/bc791ed3513e4bc39bfbe6711147ea59 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:42.903846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1390159d-45a7-4e59-bf25-550159e1c1a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625af568561f4c2bb2f476d00a8f1570', 'request_id': 'req-1390159d-45a7-4e59-bf25-550159e1c1a6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:42.911715 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1390159d-45a7-4e59-bf25-550159e1c1a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625af568561f4c2bb2f476d00a8f1570', 'request_id': 'req-1390159d-45a7-4e59-bf25-550159e1c1a6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:42.939136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1390159d-45a7-4e59-bf25-550159e1c1a6 admin admin] The token cache is being invalidate because project 625af568561f4c2bb2f476d00a8f1570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:42.939826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1390159d-45a7-4e59-bf25-550159e1c1a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:42.940753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1390159d-45a7-4e59-bf25-550159e1c1a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:42.942608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1086/2149] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:42 2022] DELETE /identity/v3/projects/625af568561f4c2bb2f476d00a8f1570 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:42.947470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee2490-30d6-48ce-a351-75fd8eb2b658 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:42.952469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee2490-30d6-48ce-a351-75fd8eb2b658 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:42.953022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee2490-30d6-48ce-a351-75fd8eb2b658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:42.972771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a4ee2490-30d6-48ce-a351-75fd8eb2b658 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:42.974343 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a4ee2490-30d6-48ce-a351-75fd8eb2b658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:43.047283 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1064/2150] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:43.056996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87993c-3c34-4a58-989f-77868313356d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.057286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87993c-3c34-4a58-989f-77868313356d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.057566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87993c-3c34-4a58-989f-77868313356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.076118 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-bb87993c-3c34-4a58-989f-77868313356d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:43.077559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bb87993c-3c34-4a58-989f-77868313356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:43.089473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1087/2151] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:43.090815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee2490-30d6-48ce-a351-75fd8eb2b658 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:43.101358 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee2490-30d6-48ce-a351-75fd8eb2b658 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:43.106065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262348b4-93e1-401f-b401-4669b76f9cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:43.106898 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262348b4-93e1-401f-b401-4669b76f9cdf admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.107188 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262348b4-93e1-401f-b401-4669b76f9cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.107462 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262348b4-93e1-401f-b401-4669b76f9cdf admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.108818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262348b4-93e1-401f-b401-4669b76f9cdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:43.110463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262348b4-93e1-401f-b401-4669b76f9cdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:43.112103 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262348b4-93e1-401f-b401-4669b76f9cdf admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:43.128287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1065/2152] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:28:43.129265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87993c-3c34-4a58-989f-77868313356d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:43.138491 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87993c-3c34-4a58-989f-77868313356d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:43.143449 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba111de2-5200-4545-b96b-0d3ec878dd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:43.144140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba111de2-5200-4545-b96b-0d3ec878dd9f admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.144429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba111de2-5200-4545-b96b-0d3ec878dd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.144748 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba111de2-5200-4545-b96b-0d3ec878dd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.145529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba111de2-5200-4545-b96b-0d3ec878dd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:43.148068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba111de2-5200-4545-b96b-0d3ec878dd9f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:43.183098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1088/2153] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:43 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:43.187192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262348b4-93e1-401f-b401-4669b76f9cdf admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:43.203287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262348b4-93e1-401f-b401-4669b76f9cdf admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:43.293248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349c35e-38c4-46e0-896c-a951302f3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:43.294006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349c35e-38c4-46e0-896c-a951302f3deb admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.294369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349c35e-38c4-46e0-896c-a951302f3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.294728 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349c35e-38c4-46e0-896c-a951302f3deb admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.295554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349c35e-38c4-46e0-896c-a951302f3deb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:43.298787 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349c35e-38c4-46e0-896c-a951302f3deb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:43.323570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1066/2154] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:43 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:43.328255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba111de2-5200-4545-b96b-0d3ec878dd9f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:43.347030 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba111de2-5200-4545-b96b-0d3ec878dd9f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:43.355900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b1b7c-5dc5-48fe-999b-3a474fafb2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:43.357395 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b1b7c-5dc5-48fe-999b-3a474fafb2dd admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.357760 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b1b7c-5dc5-48fe-999b-3a474fafb2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.358784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b1b7c-5dc5-48fe-999b-3a474fafb2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.360145 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b1b7c-5dc5-48fe-999b-3a474fafb2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:43.363174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b1b7c-5dc5-48fe-999b-3a474fafb2dd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:43.375937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349c35e-38c4-46e0-896c-a951302f3deb admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:43.378146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6349c35e-38c4-46e0-896c-a951302f3deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:43.379183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1089/2155] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:28:43.384561 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b1b7c-5dc5-48fe-999b-3a474fafb2dd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:43.398402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b1b7c-5dc5-48fe-999b-3a474fafb2dd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:43.404096 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55524ba-f5b5-4891-a2d2-d82fe8db12ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:43.404785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55524ba-f5b5-4891-a2d2-d82fe8db12ac admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.405111 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55524ba-f5b5-4891-a2d2-d82fe8db12ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.405448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55524ba-f5b5-4891-a2d2-d82fe8db12ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.405670 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349c35e-38c4-46e0-896c-a951302f3deb admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:43.406129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55524ba-f5b5-4891-a2d2-d82fe8db12ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:43.411865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55524ba-f5b5-4891-a2d2-d82fe8db12ac admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:43.412429 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719047c8-129f-433d-9c42-bbdfd0b53617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:43.413501 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719047c8-129f-433d-9c42-bbdfd0b53617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.413789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719047c8-129f-433d-9c42-bbdfd0b53617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.414066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719047c8-129f-433d-9c42-bbdfd0b53617 admin admin] PATH_INFO: `/v3/projects/8b8af4daf82a43db88622613dfab613c` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.416410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719047c8-129f-433d-9c42-bbdfd0b53617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8af4daf82a43db88622613dfab613c)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:43.419422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719047c8-129f-433d-9c42-bbdfd0b53617 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:43.425059 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1090/2156] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:43.434231 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55524ba-f5b5-4891-a2d2-d82fe8db12ac admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:43.458448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55524ba-f5b5-4891-a2d2-d82fe8db12ac admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:43.469822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a5ed0-914c-4b48-89aa-151bcf2e21df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:43.470955 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a5ed0-914c-4b48-89aa-151bcf2e21df admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.471626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a5ed0-914c-4b48-89aa-151bcf2e21df admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.472014 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a5ed0-914c-4b48-89aa-151bcf2e21df admin admin] PATH_INFO: `/v3/projects/e8330d79e9d747f59cc964cb4b6f29f6/users/391405131d784fa4ab9c868838d38420/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.506776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-719047c8-129f-433d-9c42-bbdfd0b53617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8af4daf82a43db88622613dfab613c', 'request_id': 'req-719047c8-129f-433d-9c42-bbdfd0b53617'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:43.518251 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a5ed0-914c-4b48-89aa-151bcf2e21df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8330d79e9d747f59cc964cb4b6f29f6, user_id=391405131d784fa4ab9c868838d38420, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:43.521683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a5ed0-914c-4b48-89aa-151bcf2e21df admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:43.522511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-719047c8-129f-433d-9c42-bbdfd0b53617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8af4daf82a43db88622613dfab613c', 'request_id': 'req-719047c8-129f-433d-9c42-bbdfd0b53617'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:43.540195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-719047c8-129f-433d-9c42-bbdfd0b53617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8af4daf82a43db88622613dfab613c', 'request_id': 'req-719047c8-129f-433d-9c42-bbdfd0b53617'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:43.549162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1091/2157] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:43 2022] PUT /identity/v3/projects/e8330d79e9d747f59cc964cb4b6f29f6/users/391405131d784fa4ab9c868838d38420/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:43.561121 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a1f46-9d73-48dc-9682-8c907e96537e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.562148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a1f46-9d73-48dc-9682-8c907e96537e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.562706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a1f46-9d73-48dc-9682-8c907e96537e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.577980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-719047c8-129f-433d-9c42-bbdfd0b53617 admin admin] The token cache is being invalidate because project 8b8af4daf82a43db88622613dfab613c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:43.578419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-719047c8-129f-433d-9c42-bbdfd0b53617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:43.579141 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-719047c8-129f-433d-9c42-bbdfd0b53617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:43.587712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1067/2158] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:43 2022] DELETE /identity/v3/projects/8b8af4daf82a43db88622613dfab613c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:43.590154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade5b5a-e341-43ef-82e7-d42366d4406b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.590521 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade5b5a-e341-43ef-82e7-d42366d4406b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.590872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade5b5a-e341-43ef-82e7-d42366d4406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.593725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6c6a1f46-9d73-48dc-9682-8c907e96537e None None] MFA Rules not processed for user `391405131d784fa4ab9c868838d38420`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:43.595474 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6c6a1f46-9d73-48dc-9682-8c907e96537e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:43.637041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-aade5b5a-e341-43ef-82e7-d42366d4406b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:43.641596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-aade5b5a-e341-43ef-82e7-d42366d4406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:43.693103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1092/2159] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:43.703972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a1f46-9d73-48dc-9682-8c907e96537e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:43.705833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6c6a1f46-9d73-48dc-9682-8c907e96537e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:43.730855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1068/2160] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:43.744740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe8a3c-1653-468a-9d50-0b8b6832342a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.745170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe8a3c-1653-468a-9d50-0b8b6832342a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.746817 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe8a3c-1653-468a-9d50-0b8b6832342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.785977 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a1f46-9d73-48dc-9682-8c907e96537e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:43.788813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-f1fe8a3c-1653-468a-9d50-0b8b6832342a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:43.790301 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f351e7-db66-4f27-8da0-6af890c15c08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:43.790965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f351e7-db66-4f27-8da0-6af890c15c08 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.791247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f351e7-db66-4f27-8da0-6af890c15c08 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.791518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f351e7-db66-4f27-8da0-6af890c15c08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.794481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f1fe8a3c-1653-468a-9d50-0b8b6832342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:43.802904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f351e7-db66-4f27-8da0-6af890c15c08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:43.804393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f351e7-db66-4f27-8da0-6af890c15c08 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:43.816587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1069/2161] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:43.820842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1093/2162] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:28:43.821006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe8a3c-1653-468a-9d50-0b8b6832342a None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:43.845384 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe8a3c-1653-468a-9d50-0b8b6832342a None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:43.857692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3e2da-f2bf-4ba2-8303-774be7d58f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:43.861196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3e2da-f2bf-4ba2-8303-774be7d58f18 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.861535 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3e2da-f2bf-4ba2-8303-774be7d58f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.861932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3e2da-f2bf-4ba2-8303-774be7d58f18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.862751 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3e2da-f2bf-4ba2-8303-774be7d58f18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:43.865248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3e2da-f2bf-4ba2-8303-774be7d58f18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:43.866997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3e2da-f2bf-4ba2-8303-774be7d58f18 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:43.899435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1070/2163] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:28:43.900521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f351e7-db66-4f27-8da0-6af890c15c08 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:43.922685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f351e7-db66-4f27-8da0-6af890c15c08 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:43.936079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6e27a-639c-4e94-9522-3a065aefa6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:43.938034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6e27a-639c-4e94-9522-3a065aefa6ef admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:43.938402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6e27a-639c-4e94-9522-3a065aefa6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:43.938670 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6e27a-639c-4e94-9522-3a065aefa6ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:43.939380 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6e27a-639c-4e94-9522-3a065aefa6ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:43.941549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6e27a-639c-4e94-9522-3a065aefa6ef admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:44.003345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1094/2164] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:43 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:44.004592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3e2da-f2bf-4ba2-8303-774be7d58f18 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:44.021629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3e2da-f2bf-4ba2-8303-774be7d58f18 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:44.143275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3b0f3-10c4-4403-8eae-98ca85627404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:44.143275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3b0f3-10c4-4403-8eae-98ca85627404 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:44.143275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3b0f3-10c4-4403-8eae-98ca85627404 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:44.143275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3b0f3-10c4-4403-8eae-98ca85627404 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:44.143757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3b0f3-10c4-4403-8eae-98ca85627404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:44.152428 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3b0f3-10c4-4403-8eae-98ca85627404 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:44.203710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1071/2165] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:44 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:44.208140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6e27a-639c-4e94-9522-3a065aefa6ef admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:44.221294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6e27a-639c-4e94-9522-3a065aefa6ef admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:44.238165 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632e824-1019-46c1-88c9-a689131f3306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:44.238820 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e824-1019-46c1-88c9-a689131f3306 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:44.239355 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e824-1019-46c1-88c9-a689131f3306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:44.239734 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e824-1019-46c1-88c9-a689131f3306 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:44.240622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632e824-1019-46c1-88c9-a689131f3306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:44.244836 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632e824-1019-46c1-88c9-a689131f3306 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:44.267806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1095/2166] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:44.273119 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3b0f3-10c4-4403-8eae-98ca85627404 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:44.288218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3b0f3-10c4-4403-8eae-98ca85627404 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:44.309462 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda55ba-6b91-430a-8394-b2d220aae343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:44.310735 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda55ba-6b91-430a-8394-b2d220aae343 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:44.311090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda55ba-6b91-430a-8394-b2d220aae343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:44.311674 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda55ba-6b91-430a-8394-b2d220aae343 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:44.312720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda55ba-6b91-430a-8394-b2d220aae343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:44.314408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda55ba-6b91-430a-8394-b2d220aae343 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:44.344362 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1072/2167] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:44.348504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632e824-1019-46c1-88c9-a689131f3306 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:44.363206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632e824-1019-46c1-88c9-a689131f3306 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:44.380806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a5247-5a4e-402a-9b3d-e9dab53b2a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:44.381717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5247-5a4e-402a-9b3d-e9dab53b2a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:44.382124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5247-5a4e-402a-9b3d-e9dab53b2a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:44.382825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5247-5a4e-402a-9b3d-e9dab53b2a0d admin admin] PATH_INFO: `/v3/projects/06161d2bb1bc42e6aa6d5273574be351/users/c4ce46898b1540fc98c6a6cf1e6b87b9/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:44.404436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a5247-5a4e-402a-9b3d-e9dab53b2a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06161d2bb1bc42e6aa6d5273574be351, user_id=c4ce46898b1540fc98c6a6cf1e6b87b9, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:44.407205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a5247-5a4e-402a-9b3d-e9dab53b2a0d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:44.426080 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1096/2168] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:44 2022] PUT /identity/v3/projects/06161d2bb1bc42e6aa6d5273574be351/users/c4ce46898b1540fc98c6a6cf1e6b87b9/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:44.431658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021ccb3-d171-4f9a-8e56-b37a8c91a842 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:44.432127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021ccb3-d171-4f9a-8e56-b37a8c91a842 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:44.432410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021ccb3-d171-4f9a-8e56-b37a8c91a842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:44.458442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-b021ccb3-d171-4f9a-8e56-b37a8c91a842 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:44.460555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-b021ccb3-d171-4f9a-8e56-b37a8c91a842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:44.534798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1073/2169] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:44.541761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a5247-5a4e-402a-9b3d-e9dab53b2a0d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:44.543878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5c7a5247-5a4e-402a-9b3d-e9dab53b2a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:44.633286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a5247-5a4e-402a-9b3d-e9dab53b2a0d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:44.637850 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad457a4-dc9e-4b6e-988a-bcfe4591ab2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:44.638571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad457a4-dc9e-4b6e-988a-bcfe4591ab2a service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:44.640505 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad457a4-dc9e-4b6e-988a-bcfe4591ab2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:44.641336 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad457a4-dc9e-4b6e-988a-bcfe4591ab2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:44.651967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad457a4-dc9e-4b6e-988a-bcfe4591ab2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:44.653617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad457a4-dc9e-4b6e-988a-bcfe4591ab2a service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:44.663992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1097/2170] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:45.544785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a78e6-84b0-4244-850a-7cb3801d190e None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:45.545311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a78e6-84b0-4244-850a-7cb3801d190e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:45.545666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a78e6-84b0-4244-850a-7cb3801d190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:45.608509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-1d4a78e6-84b0-4244-850a-7cb3801d190e None None] MFA Rules not processed for user `c4ce46898b1540fc98c6a6cf1e6b87b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:45.609922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1d4a78e6-84b0-4244-850a-7cb3801d190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:45.729445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1074/2171] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:45.749769 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b45c65-0008-4d7b-89bb-21a8fd0c27be None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:45.750318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b45c65-0008-4d7b-89bb-21a8fd0c27be None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:45.750318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b45c65-0008-4d7b-89bb-21a8fd0c27be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:45.784738 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-49b45c65-0008-4d7b-89bb-21a8fd0c27be None None] MFA Rules not processed for user `c4ce46898b1540fc98c6a6cf1e6b87b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:45.786114 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-49b45c65-0008-4d7b-89bb-21a8fd0c27be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:45.795085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1098/2172] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:45.806733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a78e6-84b0-4244-850a-7cb3801d190e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:45.808451 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1d4a78e6-84b0-4244-850a-7cb3801d190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:45.923465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a78e6-84b0-4244-850a-7cb3801d190e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:45.930191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151b926-b746-4948-8dd6-63eba7db7f77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:45.931328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151b926-b746-4948-8dd6-63eba7db7f77 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:45.931853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151b926-b746-4948-8dd6-63eba7db7f77 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:45.932193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151b926-b746-4948-8dd6-63eba7db7f77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:45.950552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151b926-b746-4948-8dd6-63eba7db7f77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:45.952898 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151b926-b746-4948-8dd6-63eba7db7f77 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:45.966612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1075/2173] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:28:46.396559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355bbe5-9635-4445-b107-aacce7c2876f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:46.396847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355bbe5-9635-4445-b107-aacce7c2876f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:46.397124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355bbe5-9635-4445-b107-aacce7c2876f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:46.433151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b355bbe5-9635-4445-b107-aacce7c2876f None None] MFA Rules not processed for user `e277c102c82b412481a8a9f888f4a7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:46.434707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b355bbe5-9635-4445-b107-aacce7c2876f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:46.533477 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1099/2174] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:46.538097 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151b926-b746-4948-8dd6-63eba7db7f77 service nova] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:46.539896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d151b926-b746-4948-8dd6-63eba7db7f77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:46.555016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151b926-b746-4948-8dd6-63eba7db7f77 service nova] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:46.559570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3b00-209c-4524-a570-92f3b2bf3ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:46.560261 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3b00-209c-4524-a570-92f3b2bf3ecd admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:46.560546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3b00-209c-4524-a570-92f3b2bf3ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:46.560818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd3b00-209c-4524-a570-92f3b2bf3ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:46.562111 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd3b00-209c-4524-a570-92f3b2bf3ecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:46.564214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd3b00-209c-4524-a570-92f3b2bf3ecd admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:46.595193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1076/2175] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:46 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:46.596423 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355bbe5-9635-4445-b107-aacce7c2876f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:46.607710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355bbe5-9635-4445-b107-aacce7c2876f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:46.666334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd7412-59f7-459f-9d22-0d639e252516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:46.667007 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd7412-59f7-459f-9d22-0d639e252516 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:46.667291 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd7412-59f7-459f-9d22-0d639e252516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:46.667564 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd7412-59f7-459f-9d22-0d639e252516 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:46.668290 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd7412-59f7-459f-9d22-0d639e252516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:46.670222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd7412-59f7-459f-9d22-0d639e252516 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:46.691342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1100/2176] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:46 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:46.695734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3b00-209c-4524-a570-92f3b2bf3ecd admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:46.707842 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd3b00-209c-4524-a570-92f3b2bf3ecd admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:46.712682 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bcc89-4a69-4cc1-8f8b-013929a16954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:46.713574 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bcc89-4a69-4cc1-8f8b-013929a16954 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:46.713852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bcc89-4a69-4cc1-8f8b-013929a16954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:46.714134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bcc89-4a69-4cc1-8f8b-013929a16954 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:46.714858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bcc89-4a69-4cc1-8f8b-013929a16954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:46.716633 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bcc89-4a69-4cc1-8f8b-013929a16954 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:46.728177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1077/2177] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:46.732679 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd7412-59f7-459f-9d22-0d639e252516 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:46.749244 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd7412-59f7-459f-9d22-0d639e252516 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:46.754724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced47409-9c36-41ec-91ba-350ea194d5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:46.755749 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced47409-9c36-41ec-91ba-350ea194d5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:46.756067 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced47409-9c36-41ec-91ba-350ea194d5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:46.756543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced47409-9c36-41ec-91ba-350ea194d5d9 admin admin] PATH_INFO: `/v3/projects/9d072d981d204ad2be5592d7ff1c2b4b/users/3232866e556a4c1889ee521ae0ab3983/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:46.775573 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced47409-9c36-41ec-91ba-350ea194d5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d072d981d204ad2be5592d7ff1c2b4b, user_id=3232866e556a4c1889ee521ae0ab3983, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:46.778775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced47409-9c36-41ec-91ba-350ea194d5d9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:46.802090 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1101/2178] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:46 2022] PUT /identity/v3/projects/9d072d981d204ad2be5592d7ff1c2b4b/users/3232866e556a4c1889ee521ae0ab3983/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:46.806295 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bcc89-4a69-4cc1-8f8b-013929a16954 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:46.818351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bcc89-4a69-4cc1-8f8b-013929a16954 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:46.883657 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd18df0-af8c-4c13-bf3f-37720bad511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:46.884361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd18df0-af8c-4c13-bf3f-37720bad511e admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:46.884647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd18df0-af8c-4c13-bf3f-37720bad511e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:46.885343 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd18df0-af8c-4c13-bf3f-37720bad511e admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:46.885746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd18df0-af8c-4c13-bf3f-37720bad511e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:46.887335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd18df0-af8c-4c13-bf3f-37720bad511e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:46.900971 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1078/2179] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:28:46.902776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced47409-9c36-41ec-91ba-350ea194d5d9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:46.914128 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced47409-9c36-41ec-91ba-350ea194d5d9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:46.919643 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c449eca-17f8-47d1-b26d-e2f72f91ca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:46.921201 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c449eca-17f8-47d1-b26d-e2f72f91ca4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:46.921493 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c449eca-17f8-47d1-b26d-e2f72f91ca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:46.921769 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c449eca-17f8-47d1-b26d-e2f72f91ca4c admin admin] PATH_INFO: `/v3/projects/9d072d981d204ad2be5592d7ff1c2b4b/users/3232866e556a4c1889ee521ae0ab3983/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:46.923844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c449eca-17f8-47d1-b26d-e2f72f91ca4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d072d981d204ad2be5592d7ff1c2b4b, user_id=3232866e556a4c1889ee521ae0ab3983, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:46.926898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c449eca-17f8-47d1-b26d-e2f72f91ca4c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:46.939368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1102/2180] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:46 2022] PUT /identity/v3/projects/9d072d981d204ad2be5592d7ff1c2b4b/users/3232866e556a4c1889ee521ae0ab3983/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:47.555243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd18df0-af8c-4c13-bf3f-37720bad511e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:47.557039 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ddd18df0-af8c-4c13-bf3f-37720bad511e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:47.580881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd18df0-af8c-4c13-bf3f-37720bad511e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:47.662481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:47.663613 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:47.663891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:47.664258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] PATH_INFO: `/v3/users/391405131d784fa4ab9c868838d38420` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:47.665475 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=391405131d784fa4ab9c868838d38420)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:47.667429 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:47.727010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '391405131d784fa4ab9c868838d38420'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:47.741568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '391405131d784fa4ab9c868838d38420'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:47.751223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '391405131d784fa4ab9c868838d38420'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:47.761222 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '391405131d784fa4ab9c868838d38420'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:47.761977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '391405131d784fa4ab9c868838d38420'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:47.768695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1079/2181] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:28:47 2022] DELETE /identity/v3/users/391405131d784fa4ab9c868838d38420 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:47.773705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25740c-4b4d-4a05-bf84-a7d277fe0686 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:47.774221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25740c-4b4d-4a05-bf84-a7d277fe0686 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:47.774711 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25740c-4b4d-4a05-bf84-a7d277fe0686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:47.814504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1d25740c-4b4d-4a05-bf84-a7d277fe0686 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:47.815894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1d25740c-4b4d-4a05-bf84-a7d277fe0686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:47.897537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1103/2182] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:47.909090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:47.911292 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:47.978126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eeec75-3bfb-48ed-ab3a-5fae46e0d414 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:47.986545 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601d23b-aaf5-4718-9fc4-b23a993b51b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:47.987491 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601d23b-aaf5-4718-9fc4-b23a993b51b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:47.988178 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601d23b-aaf5-4718-9fc4-b23a993b51b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:47.989520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601d23b-aaf5-4718-9fc4-b23a993b51b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:48.002897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601d23b-aaf5-4718-9fc4-b23a993b51b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:48.004643 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601d23b-aaf5-4718-9fc4-b23a993b51b1 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:48.036383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1080/2183] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:48.464077 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25740c-4b4d-4a05-bf84-a7d277fe0686 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:48.465743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1d25740c-4b4d-4a05-bf84-a7d277fe0686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:48.479229 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25740c-4b4d-4a05-bf84-a7d277fe0686 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:48.484683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c367473-fe4a-4425-9acc-8912585db593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:48.485706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c367473-fe4a-4425-9acc-8912585db593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:48.486143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c367473-fe4a-4425-9acc-8912585db593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:48.486419 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c367473-fe4a-4425-9acc-8912585db593 admin admin] PATH_INFO: `/v3/projects/e8330d79e9d747f59cc964cb4b6f29f6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:48.487784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c367473-fe4a-4425-9acc-8912585db593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8330d79e9d747f59cc964cb4b6f29f6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:48.490203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c367473-fe4a-4425-9acc-8912585db593 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:48.555268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1c367473-fe4a-4425-9acc-8912585db593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8330d79e9d747f59cc964cb4b6f29f6', 'request_id': 'req-1c367473-fe4a-4425-9acc-8912585db593'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:48.563212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1c367473-fe4a-4425-9acc-8912585db593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8330d79e9d747f59cc964cb4b6f29f6', 'request_id': 'req-1c367473-fe4a-4425-9acc-8912585db593'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:48.569671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1c367473-fe4a-4425-9acc-8912585db593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8330d79e9d747f59cc964cb4b6f29f6', 'request_id': 'req-1c367473-fe4a-4425-9acc-8912585db593'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:48.585582 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1c367473-fe4a-4425-9acc-8912585db593 admin admin] The token cache is being invalidate because project e8330d79e9d747f59cc964cb4b6f29f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:28:48.586041 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1c367473-fe4a-4425-9acc-8912585db593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:48.586784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1c367473-fe4a-4425-9acc-8912585db593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:28:48.588498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1104/2184] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:28:48 2022] DELETE /identity/v3/projects/e8330d79e9d747f59cc964cb4b6f29f6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:48.595741 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227277f-68a6-4fa8-9202-fd992c3ac7a7 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:48.596276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227277f-68a6-4fa8-9202-fd992c3ac7a7 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:48.596367 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227277f-68a6-4fa8-9202-fd992c3ac7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:48.621968 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-4227277f-68a6-4fa8-9202-fd992c3ac7a7 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:48.623511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4227277f-68a6-4fa8-9202-fd992c3ac7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:48.699822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1081/2185] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:48.708263 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c373c8-65e1-4c16-a96b-c4048388b878 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:48.708708 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c373c8-65e1-4c16-a96b-c4048388b878 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:48.709088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c373c8-65e1-4c16-a96b-c4048388b878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:48.737778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b3c373c8-65e1-4c16-a96b-c4048388b878 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:48.739328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b3c373c8-65e1-4c16-a96b-c4048388b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:48.753535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1105/2186] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:48.758593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227277f-68a6-4fa8-9202-fd992c3ac7a7 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:48.769616 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227277f-68a6-4fa8-9202-fd992c3ac7a7 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:48.776616 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136a01f-4eda-4730-9d21-95d479dbad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:48.777827 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a01f-4eda-4730-9d21-95d479dbad87 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:48.778246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a01f-4eda-4730-9d21-95d479dbad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:48.778716 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136a01f-4eda-4730-9d21-95d479dbad87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:48.779588 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136a01f-4eda-4730-9d21-95d479dbad87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:28:48.780710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136a01f-4eda-4730-9d21-95d479dbad87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:48.782787 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136a01f-4eda-4730-9d21-95d479dbad87 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:48.797911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1082/2187] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:28:48.802276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c373c8-65e1-4c16-a96b-c4048388b878 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:48.812574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c373c8-65e1-4c16-a96b-c4048388b878 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:48.818987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023457a-1fd3-4b73-bce0-3662b30ec15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:48.819758 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023457a-1fd3-4b73-bce0-3662b30ec15c admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:48.820072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023457a-1fd3-4b73-bce0-3662b30ec15c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:48.820361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023457a-1fd3-4b73-bce0-3662b30ec15c admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:48.821441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023457a-1fd3-4b73-bce0-3662b30ec15c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:48.823134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023457a-1fd3-4b73-bce0-3662b30ec15c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:48.850728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1106/2188] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:48 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:48.854764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136a01f-4eda-4730-9d21-95d479dbad87 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:48.866162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136a01f-4eda-4730-9d21-95d479dbad87 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:48.933015 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33748173-d0ef-4c75-b339-06e9f4ea1685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:48.933842 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33748173-d0ef-4c75-b339-06e9f4ea1685 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:48.934319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33748173-d0ef-4c75-b339-06e9f4ea1685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:48.934703 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33748173-d0ef-4c75-b339-06e9f4ea1685 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:48.935494 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33748173-d0ef-4c75-b339-06e9f4ea1685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:48.938240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33748173-d0ef-4c75-b339-06e9f4ea1685 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:48.964000 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1083/2189] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:48 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:48.968441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023457a-1fd3-4b73-bce0-3662b30ec15c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:48.981349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023457a-1fd3-4b73-bce0-3662b30ec15c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:48.990985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a74574-4eca-4d03-a239-4b7ba9f6f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:48.991859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a74574-4eca-4d03-a239-4b7ba9f6f049 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:48.992321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a74574-4eca-4d03-a239-4b7ba9f6f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:48.992745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a74574-4eca-4d03-a239-4b7ba9f6f049 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:48.993644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a74574-4eca-4d03-a239-4b7ba9f6f049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:48.995554 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a74574-4eca-4d03-a239-4b7ba9f6f049 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:49.021409 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1107/2190] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:49.025345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33748173-d0ef-4c75-b339-06e9f4ea1685 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:49.045885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33748173-d0ef-4c75-b339-06e9f4ea1685 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:49.052134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8f88c-348b-4625-b249-c5addaf6b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:49.053022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8f88c-348b-4625-b249-c5addaf6b6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:49.053463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8f88c-348b-4625-b249-c5addaf6b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:49.053934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8f88c-348b-4625-b249-c5addaf6b6c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:49.054812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8f88c-348b-4625-b249-c5addaf6b6c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:49.058057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8f88c-348b-4625-b249-c5addaf6b6c1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:49.070471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1084/2191] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:49.074790 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a74574-4eca-4d03-a239-4b7ba9f6f049 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:49.105932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a74574-4eca-4d03-a239-4b7ba9f6f049 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:49.119233 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a638580-a2b1-4295-873c-2986cdcc37f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:49.120738 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a638580-a2b1-4295-873c-2986cdcc37f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:49.121171 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a638580-a2b1-4295-873c-2986cdcc37f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:49.122402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a638580-a2b1-4295-873c-2986cdcc37f1 admin admin] PATH_INFO: `/v3/projects/95e44d55b575475e983667536f98ba1b/users/b3065c8eadb94eb79ccd835729fafc02/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:49.144502 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a638580-a2b1-4295-873c-2986cdcc37f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e44d55b575475e983667536f98ba1b, user_id=b3065c8eadb94eb79ccd835729fafc02, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:49.148600 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a638580-a2b1-4295-873c-2986cdcc37f1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:49.195262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1108/2192] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:49 2022] PUT /identity/v3/projects/95e44d55b575475e983667536f98ba1b/users/b3065c8eadb94eb79ccd835729fafc02/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:28:49.197051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a9ee-ab10-456e-b5a0-4345973a7835 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:49.197344 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a9ee-ab10-456e-b5a0-4345973a7835 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:49.197652 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4a9ee-ab10-456e-b5a0-4345973a7835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:49.230977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-37f4a9ee-ab10-456e-b5a0-4345973a7835 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:49.238878 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-37f4a9ee-ab10-456e-b5a0-4345973a7835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:49.420484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1085/2193] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:49.447436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a638580-a2b1-4295-873c-2986cdcc37f1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:49.454346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0a638580-a2b1-4295-873c-2986cdcc37f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:49.567156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a638580-a2b1-4295-873c-2986cdcc37f1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:49.579474 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85766792-3598-4b08-8e23-f44ac1dced92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:49.580733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85766792-3598-4b08-8e23-f44ac1dced92 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:49.581095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85766792-3598-4b08-8e23-f44ac1dced92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:49.581446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85766792-3598-4b08-8e23-f44ac1dced92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:49.600097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85766792-3598-4b08-8e23-f44ac1dced92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:49.602296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85766792-3598-4b08-8e23-f44ac1dced92 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:49.630656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1109/2194] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:53.326152 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8ef99-ced3-474c-98aa-8731c5458af9 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:53.326743 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8ef99-ced3-474c-98aa-8731c5458af9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:53.326743 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8ef99-ced3-474c-98aa-8731c5458af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:53.386550 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-56f8ef99-ced3-474c-98aa-8731c5458af9 None None] MFA Rules not processed for user `3232866e556a4c1889ee521ae0ab3983`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:53.387793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-56f8ef99-ced3-474c-98aa-8731c5458af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:53.513102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1086/2195] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:28:53.524145 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85766792-3598-4b08-8e23-f44ac1dced92 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:53.525582 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-85766792-3598-4b08-8e23-f44ac1dced92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:53.620680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85766792-3598-4b08-8e23-f44ac1dced92 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:53.628578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dba42-6f66-45b3-98f3-78137d08585e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:53.629261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dba42-6f66-45b3-98f3-78137d08585e service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:53.629541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dba42-6f66-45b3-98f3-78137d08585e service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:53.629947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dba42-6f66-45b3-98f3-78137d08585e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:53.633527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-143dba42-6f66-45b3-98f3-78137d08585e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:53.721656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dba42-6f66-45b3-98f3-78137d08585e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:53.723364 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dba42-6f66-45b3-98f3-78137d08585e service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:53.734778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1110/2196] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:28:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:28:57.020417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2579a-6371-45b1-81fe-03ead6c0bd1c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:57.029568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2579a-6371-45b1-81fe-03ead6c0bd1c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:57.030648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2579a-6371-45b1-81fe-03ead6c0bd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:57.072595 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0bf2579a-6371-45b1-81fe-03ead6c0bd1c None None] MFA Rules not processed for user `b3065c8eadb94eb79ccd835729fafc02`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:28:57.075729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0bf2579a-6371-45b1-81fe-03ead6c0bd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:28:57.175342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1087/2197] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:28:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:28:57.176243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dba42-6f66-45b3-98f3-78137d08585e service nova] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:57.193148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dba42-6f66-45b3-98f3-78137d08585e service nova] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:57.207964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0e7bd-8c01-43e5-abc6-1c0976ee312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:57.208848 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0e7bd-8c01-43e5-abc6-1c0976ee312a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:57.209131 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0e7bd-8c01-43e5-abc6-1c0976ee312a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:57.213095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0e7bd-8c01-43e5-abc6-1c0976ee312a admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:57.216476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0e7bd-8c01-43e5-abc6-1c0976ee312a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:57.219414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0e7bd-8c01-43e5-abc6-1c0976ee312a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:57.287454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1111/2198] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:28:57 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:28:57.291203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2579a-6371-45b1-81fe-03ead6c0bd1c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:57.310510 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2579a-6371-45b1-81fe-03ead6c0bd1c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:57.399427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a088f-7203-4685-aefb-543e3ae95433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:57.400299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a088f-7203-4685-aefb-543e3ae95433 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:57.400725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a088f-7203-4685-aefb-543e3ae95433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:57.400970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a088f-7203-4685-aefb-543e3ae95433 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:57.401841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a088f-7203-4685-aefb-543e3ae95433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:57.404510 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a088f-7203-4685-aefb-543e3ae95433 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:57.433449 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1088/2199] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:28:57 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:28:57.444216 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0e7bd-8c01-43e5-abc6-1c0976ee312a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:57.479862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0e7bd-8c01-43e5-abc6-1c0976ee312a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:57.489136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21dce8-cdf5-4ce9-9329-ed7edf558eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:57.491507 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21dce8-cdf5-4ce9-9329-ed7edf558eac admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:57.491876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21dce8-cdf5-4ce9-9329-ed7edf558eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:57.492265 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21dce8-cdf5-4ce9-9329-ed7edf558eac admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:57.493082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21dce8-cdf5-4ce9-9329-ed7edf558eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:57.495321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21dce8-cdf5-4ce9-9329-ed7edf558eac admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:57.507468 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1112/2200] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:28:57.511785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a088f-7203-4685-aefb-543e3ae95433 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:57.527782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a088f-7203-4685-aefb-543e3ae95433 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:57.533144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c0195-6c53-4d84-9db7-675b5136df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:57.534089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c0195-6c53-4d84-9db7-675b5136df42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:57.534488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c0195-6c53-4d84-9db7-675b5136df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:57.534822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c0195-6c53-4d84-9db7-675b5136df42 admin admin] PATH_INFO: `/v3/projects/426013f10809459289e69d69c8bc475c/users/2997f2b87c2e4be0aa90f3a9e153c243/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:57.559498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c0195-6c53-4d84-9db7-675b5136df42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426013f10809459289e69d69c8bc475c, user_id=2997f2b87c2e4be0aa90f3a9e153c243, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:57.563247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c0195-6c53-4d84-9db7-675b5136df42 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:57.580706 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1089/2201] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:57 2022] PUT /identity/v3/projects/426013f10809459289e69d69c8bc475c/users/2997f2b87c2e4be0aa90f3a9e153c243/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:28:57.585066 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21dce8-cdf5-4ce9-9329-ed7edf558eac admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:57.596318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21dce8-cdf5-4ce9-9329-ed7edf558eac admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:57.676440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d2a4d-1391-464a-9054-65b5d64416d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:57.679231 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d2a4d-1391-464a-9054-65b5d64416d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:57.679521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d2a4d-1391-464a-9054-65b5d64416d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:57.679801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d2a4d-1391-464a-9054-65b5d64416d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:57.680572 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d2a4d-1391-464a-9054-65b5d64416d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:57.682217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d2a4d-1391-464a-9054-65b5d64416d0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:57.694243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1113/2202] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:28:57.698312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c0195-6c53-4d84-9db7-675b5136df42 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:28:57.709638 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c0195-6c53-4d84-9db7-675b5136df42 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:28:57.714606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d1729-3adf-4bb9-9375-f9091d866105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:28:57.715506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d1729-3adf-4bb9-9375-f9091d866105 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:28:57.715792 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d1729-3adf-4bb9-9375-f9091d866105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:28:57.716102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d1729-3adf-4bb9-9375-f9091d866105 admin admin] PATH_INFO: `/v3/projects/426013f10809459289e69d69c8bc475c/users/2997f2b87c2e4be0aa90f3a9e153c243/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:28:57.718232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d1729-3adf-4bb9-9375-f9091d866105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426013f10809459289e69d69c8bc475c, user_id=2997f2b87c2e4be0aa90f3a9e153c243, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:28:57.720933 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d1729-3adf-4bb9-9375-f9091d866105 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:28:57.731963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1090/2203] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:28:57 2022] PUT /identity/v3/projects/426013f10809459289e69d69c8bc475c/users/2997f2b87c2e4be0aa90f3a9e153c243/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:29:03.201013 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940f7c8-7b06-44a3-97a2-676cb7d819f9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:03.201500 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940f7c8-7b06-44a3-97a2-676cb7d819f9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:03.203224 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940f7c8-7b06-44a3-97a2-676cb7d819f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:03.253676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e940f7c8-7b06-44a3-97a2-676cb7d819f9 None None] MFA Rules not processed for user `2997f2b87c2e4be0aa90f3a9e153c243`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:03.255119 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e940f7c8-7b06-44a3-97a2-676cb7d819f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:03.401011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1114/2204] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:06.971390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d1729-3adf-4bb9-9375-f9091d866105 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:06.973184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-116d1729-3adf-4bb9-9375-f9091d866105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:07.042318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d1729-3adf-4bb9-9375-f9091d866105 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:07.047704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d83380-0f7e-494f-8842-f768ac113bb5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5074090dca0b4a49b54dc252a5dd9420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:07.048498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d83380-0f7e-494f-8842-f768ac113bb5 service glance] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:07.049002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d83380-0f7e-494f-8842-f768ac113bb5 service glance] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:07.049345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d83380-0f7e-494f-8842-f768ac113bb5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:07.109028 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d83380-0f7e-494f-8842-f768ac113bb5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:07.110490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d83380-0f7e-494f-8842-f768ac113bb5 service glance] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:07.119906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1091/2205] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:29:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:29:07.303366 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659324f8-abcf-42ef-af27-3a3aebf362a8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:07.304320 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659324f8-abcf-42ef-af27-3a3aebf362a8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:07.304779 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659324f8-abcf-42ef-af27-3a3aebf362a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:07.325628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-659324f8-abcf-42ef-af27-3a3aebf362a8 None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:07.327759 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-659324f8-abcf-42ef-af27-3a3aebf362a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:07.391349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1115/2206] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:29:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:07.435089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d83380-0f7e-494f-8842-f768ac113bb5 service glance] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:07.436726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-07d83380-0f7e-494f-8842-f768ac113bb5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:07.507780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d83380-0f7e-494f-8842-f768ac113bb5 service glance] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:07.513228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaccee9-abd4-4ec8-ae12-feae7239e095 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:07.513979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaccee9-abd4-4ec8-ae12-feae7239e095 service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:07.514896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaccee9-abd4-4ec8-ae12-feae7239e095 service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:07.515269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaccee9-abd4-4ec8-ae12-feae7239e095 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:07.524455 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaccee9-abd4-4ec8-ae12-feae7239e095 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:07.526873 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaccee9-abd4-4ec8-ae12-feae7239e095 service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:07.538175 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1092/2207] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:29:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:29:17.614387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185da7e-e8c3-4595-861e-14acd925a093 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:17.614921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185da7e-e8c3-4595-861e-14acd925a093 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:17.615082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185da7e-e8c3-4595-861e-14acd925a093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:17.636289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-9185da7e-e8c3-4595-861e-14acd925a093 None None] MFA Rules not processed for user `b3065c8eadb94eb79ccd835729fafc02`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:17.637469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9185da7e-e8c3-4595-861e-14acd925a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:17.645348 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1116/2208] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:21.354575 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694ba1e-9b8e-4ec1-8dca-fd36905f4876 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:21.355436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694ba1e-9b8e-4ec1-8dca-fd36905f4876 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:21.355726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694ba1e-9b8e-4ec1-8dca-fd36905f4876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:21.376825 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-9694ba1e-9b8e-4ec1-8dca-fd36905f4876 None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:21.378026 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9694ba1e-9b8e-4ec1-8dca-fd36905f4876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:21.385336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1093/2209] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:29:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:29:21.398564 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185da7e-e8c3-4595-861e-14acd925a093 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:21.412952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185da7e-e8c3-4595-861e-14acd925a093 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:21.418258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ec736-d6c0-426a-9e6f-ec50f6ea42b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:21.418907 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ec736-d6c0-426a-9e6f-ec50f6ea42b9 service swift] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:21.419191 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ec736-d6c0-426a-9e6f-ec50f6ea42b9 service swift] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:21.419466 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ec736-d6c0-426a-9e6f-ec50f6ea42b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:21.428948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ec736-d6c0-426a-9e6f-ec50f6ea42b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:21.430690 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ec736-d6c0-426a-9e6f-ec50f6ea42b9 service swift] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:21.439543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1117/2210] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:29:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:29:25.185045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694ba1e-9b8e-4ec1-8dca-fd36905f4876 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:25.187229 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9694ba1e-9b8e-4ec1-8dca-fd36905f4876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:25.277337 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694ba1e-9b8e-4ec1-8dca-fd36905f4876 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:25.282547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:25.283408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:25.283687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:25.283960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] PATH_INFO: `/v3/users/69e6d88b925e4de39d46951b84cb7bc9` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:25.285195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e6d88b925e4de39d46951b84cb7bc9)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:25.287110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:25.338485 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e6d88b925e4de39d46951b84cb7bc9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:25.352489 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e6d88b925e4de39d46951b84cb7bc9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:25.360258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e6d88b925e4de39d46951b84cb7bc9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:25.367178 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e6d88b925e4de39d46951b84cb7bc9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:25.367830 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e6d88b925e4de39d46951b84cb7bc9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:25.373636 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1094/2211] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:29:25 2022] DELETE /identity/v3/users/69e6d88b925e4de39d46951b84cb7bc9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:29:25.378599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55473477-e75a-4bd8-a468-8519c970c509 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:25.379118 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55473477-e75a-4bd8-a468-8519c970c509 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:25.379212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55473477-e75a-4bd8-a468-8519c970c509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:25.396728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-55473477-e75a-4bd8-a468-8519c970c509 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:25.397946 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-55473477-e75a-4bd8-a468-8519c970c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:25.473434 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1118/2212] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:25.482863 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:25.484437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:25.546864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8389b9-a9ec-4cd0-bc70-86f6e353db78 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:25.550731 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fd243-3fe8-4200-a1de-5a91372aa6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:25.551531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fd243-3fe8-4200-a1de-5a91372aa6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:25.551897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fd243-3fe8-4200-a1de-5a91372aa6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:25.552318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fd243-3fe8-4200-a1de-5a91372aa6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:25.565654 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fd243-3fe8-4200-a1de-5a91372aa6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:25.567355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fd243-3fe8-4200-a1de-5a91372aa6f6 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:25.580734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1095/2213] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:29:25.884495 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55473477-e75a-4bd8-a468-8519c970c509 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:25.886255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-55473477-e75a-4bd8-a468-8519c970c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:25.898965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55473477-e75a-4bd8-a468-8519c970c509 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:25.903952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:25.905024 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:25.905810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:25.906805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9 admin admin] PATH_INFO: `/v3/projects/e2e9a4fdafaf4200a5248f842d5757f3` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:25.908183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e9a4fdafaf4200a5248f842d5757f3)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:25.910383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:25.997296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e9a4fdafaf4200a5248f842d5757f3', 'request_id': 'req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:26.004078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e9a4fdafaf4200a5248f842d5757f3', 'request_id': 'req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:26.017078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e9a4fdafaf4200a5248f842d5757f3', 'request_id': 'req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:26.038675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9 admin admin] The token cache is being invalidate because project e2e9a4fdafaf4200a5248f842d5757f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:29:26.039070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:26.040000 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-76eefee8-a651-4402-8cf7-a09dc6c2c3e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:26.041999 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1119/2214] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:29:25 2022] DELETE /identity/v3/projects/e2e9a4fdafaf4200a5248f842d5757f3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:29:26.047858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48c250-942b-49bf-80d9-64d457d8d2a3 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:26.048185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48c250-942b-49bf-80d9-64d457d8d2a3 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:26.048492 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48c250-942b-49bf-80d9-64d457d8d2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:26.076307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-9f48c250-942b-49bf-80d9-64d457d8d2a3 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:26.078143 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9f48c250-942b-49bf-80d9-64d457d8d2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:26.145094 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1096/2215] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:26.152454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b49342-c633-44fd-a9ed-e3703fdd8426 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:26.153253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b49342-c633-44fd-a9ed-e3703fdd8426 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:26.153700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b49342-c633-44fd-a9ed-e3703fdd8426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:26.197715 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-11b49342-c633-44fd-a9ed-e3703fdd8426 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:26.198923 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-11b49342-c633-44fd-a9ed-e3703fdd8426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:26.207597 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1120/2216] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:26.211985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48c250-942b-49bf-80d9-64d457d8d2a3 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:26.222214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48c250-942b-49bf-80d9-64d457d8d2a3 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:26.226987 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b623c7-ca12-4587-a91f-afec54a7d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:26.227647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b623c7-ca12-4587-a91f-afec54a7d3ae admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:26.227935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b623c7-ca12-4587-a91f-afec54a7d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:26.228257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b623c7-ca12-4587-a91f-afec54a7d3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:26.228981 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b623c7-ca12-4587-a91f-afec54a7d3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:29:26.229289 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b623c7-ca12-4587-a91f-afec54a7d3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:26.232068 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b623c7-ca12-4587-a91f-afec54a7d3ae admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:26.248978 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1097/2217] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:29:26.253293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b49342-c633-44fd-a9ed-e3703fdd8426 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:26.272758 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b49342-c633-44fd-a9ed-e3703fdd8426 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:26.278899 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63da44-f091-446c-93b6-01cf1bbca3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:26.279804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63da44-f091-446c-93b6-01cf1bbca3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:26.280323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63da44-f091-446c-93b6-01cf1bbca3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:26.281429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63da44-f091-446c-93b6-01cf1bbca3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:26.282489 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63da44-f091-446c-93b6-01cf1bbca3e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:26.284774 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63da44-f091-446c-93b6-01cf1bbca3e7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:26.316120 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1121/2218] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:29:26 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:29:26.320302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b623c7-ca12-4587-a91f-afec54a7d3ae admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:26.330666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b623c7-ca12-4587-a91f-afec54a7d3ae admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:26.394637 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa1e8-d36f-4376-8ca5-8f42e4581222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:26.395310 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa1e8-d36f-4376-8ca5-8f42e4581222 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:26.395590 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa1e8-d36f-4376-8ca5-8f42e4581222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:26.395875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa1e8-d36f-4376-8ca5-8f42e4581222 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:26.396691 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaa1e8-d36f-4376-8ca5-8f42e4581222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:26.398602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaa1e8-d36f-4376-8ca5-8f42e4581222 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:26.418325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1098/2219] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:29:26 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:29:26.423122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63da44-f091-446c-93b6-01cf1bbca3e7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:26.434082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63da44-f091-446c-93b6-01cf1bbca3e7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:26.439999 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4e558-73be-44e4-a6e4-01d7446687d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:26.440696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4e558-73be-44e4-a6e4-01d7446687d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:26.441014 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4e558-73be-44e4-a6e4-01d7446687d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:26.441294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4e558-73be-44e4-a6e4-01d7446687d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:26.442022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4e558-73be-44e4-a6e4-01d7446687d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:26.443673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4e558-73be-44e4-a6e4-01d7446687d2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:26.457279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1122/2220] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:29:26.461632 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa1e8-d36f-4376-8ca5-8f42e4581222 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:26.474170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa1e8-d36f-4376-8ca5-8f42e4581222 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:26.479410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88e8ff-9234-4468-973e-2b90430926dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:26.480248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88e8ff-9234-4468-973e-2b90430926dc admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:26.489612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88e8ff-9234-4468-973e-2b90430926dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:26.490037 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88e8ff-9234-4468-973e-2b90430926dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:26.490949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88e8ff-9234-4468-973e-2b90430926dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:26.492795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88e8ff-9234-4468-973e-2b90430926dc admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:26.507885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1099/2221] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:29:26.509292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4e558-73be-44e4-a6e4-01d7446687d2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:26.520260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4e558-73be-44e4-a6e4-01d7446687d2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:26.525078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f189c-bef3-4d89-96ba-970eec1cf604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:26.525959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f189c-bef3-4d89-96ba-970eec1cf604 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:26.526245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f189c-bef3-4d89-96ba-970eec1cf604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:26.526522 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f189c-bef3-4d89-96ba-970eec1cf604 admin admin] PATH_INFO: `/v3/projects/b0d6bd7a00f24805b6ac961c4f766be6/users/f5e948a3d03341ceae09640ad22b566b/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:26.542856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f189c-bef3-4d89-96ba-970eec1cf604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d6bd7a00f24805b6ac961c4f766be6, user_id=f5e948a3d03341ceae09640ad22b566b, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:26.546868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f189c-bef3-4d89-96ba-970eec1cf604 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:26.559648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1123/2222] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:29:26 2022] PUT /identity/v3/projects/b0d6bd7a00f24805b6ac961c4f766be6/users/f5e948a3d03341ceae09640ad22b566b/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:29:26.572467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104f8b-5799-483a-be45-b16392445c81 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:26.572767 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104f8b-5799-483a-be45-b16392445c81 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:26.573051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3104f8b-5799-483a-be45-b16392445c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:26.611124 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-b3104f8b-5799-483a-be45-b16392445c81 None None] MFA Rules not processed for user `f5e948a3d03341ceae09640ad22b566b`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:26.612387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-b3104f8b-5799-483a-be45-b16392445c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:26.687634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1100/2223] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:26.699258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f189c-bef3-4d89-96ba-970eec1cf604 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:26.701576 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e89f189c-bef3-4d89-96ba-970eec1cf604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:26.763775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f189c-bef3-4d89-96ba-970eec1cf604 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:26.768571 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e109e5-5f12-44a8-9355-dd34f1ef4314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:26.769556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e109e5-5f12-44a8-9355-dd34f1ef4314 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:26.769995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e109e5-5f12-44a8-9355-dd34f1ef4314 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:26.770260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e109e5-5f12-44a8-9355-dd34f1ef4314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:26.779974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e109e5-5f12-44a8-9355-dd34f1ef4314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:26.781945 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e109e5-5f12-44a8-9355-dd34f1ef4314 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:26.791072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1124/2224] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:29:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:29:26.816243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104f8b-5799-483a-be45-b16392445c81 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:26.884092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3104f8b-5799-483a-be45-b16392445c81 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:26.889430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:26.891051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:26.891333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:26.891730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] PATH_INFO: `/v3/users/f5e948a3d03341ceae09640ad22b566b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:26.893134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e948a3d03341ceae09640ad22b566b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:26.895413 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:26.953789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e948a3d03341ceae09640ad22b566b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:26.965460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e948a3d03341ceae09640ad22b566b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:26.976911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e948a3d03341ceae09640ad22b566b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:26.984049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e948a3d03341ceae09640ad22b566b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:26.985041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e948a3d03341ceae09640ad22b566b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:26.991076 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1101/2225] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:29:26 2022] DELETE /identity/v3/users/f5e948a3d03341ceae09640ad22b566b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:29:26.995950 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f893c1c-3072-4bd8-9594-8ac7aab6c206 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:26.996277 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f893c1c-3072-4bd8-9594-8ac7aab6c206 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:26.996556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f893c1c-3072-4bd8-9594-8ac7aab6c206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:27.039617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7f893c1c-3072-4bd8-9594-8ac7aab6c206 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:27.041362 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7f893c1c-3072-4bd8-9594-8ac7aab6c206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:27.144865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1125/2226] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:29:27.155879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:27.158210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:27.257210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381699c1-344a-4724-a7c7-737b6102fc45 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:27.261960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ee168-ce7e-4bea-93dd-b64f39c984f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:27.262622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ee168-ce7e-4bea-93dd-b64f39c984f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:27.263037 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ee168-ce7e-4bea-93dd-b64f39c984f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:27.263316 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ee168-ce7e-4bea-93dd-b64f39c984f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:27.291415 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ee168-ce7e-4bea-93dd-b64f39c984f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:27.292858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ee168-ce7e-4bea-93dd-b64f39c984f9 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:27.307580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1102/2227] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:29:27.801577 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f893c1c-3072-4bd8-9594-8ac7aab6c206 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:27.803720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7f893c1c-3072-4bd8-9594-8ac7aab6c206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:27.837266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f893c1c-3072-4bd8-9594-8ac7aab6c206 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:27.849396 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a26d5-649f-43a6-be13-235ddf3fd800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:27.850343 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a26d5-649f-43a6-be13-235ddf3fd800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:27.851853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a26d5-649f-43a6-be13-235ddf3fd800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:27.852230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a26d5-649f-43a6-be13-235ddf3fd800 admin admin] PATH_INFO: `/v3/projects/b0d6bd7a00f24805b6ac961c4f766be6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:27.853521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a26d5-649f-43a6-be13-235ddf3fd800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d6bd7a00f24805b6ac961c4f766be6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:27.855469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a26d5-649f-43a6-be13-235ddf3fd800 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:27.941659 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1f6a26d5-649f-43a6-be13-235ddf3fd800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d6bd7a00f24805b6ac961c4f766be6', 'request_id': 'req-1f6a26d5-649f-43a6-be13-235ddf3fd800'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:27.950284 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1f6a26d5-649f-43a6-be13-235ddf3fd800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d6bd7a00f24805b6ac961c4f766be6', 'request_id': 'req-1f6a26d5-649f-43a6-be13-235ddf3fd800'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:27.960435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1f6a26d5-649f-43a6-be13-235ddf3fd800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d6bd7a00f24805b6ac961c4f766be6', 'request_id': 'req-1f6a26d5-649f-43a6-be13-235ddf3fd800'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:27.986733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1f6a26d5-649f-43a6-be13-235ddf3fd800 admin admin] The token cache is being invalidate because project b0d6bd7a00f24805b6ac961c4f766be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:29:27.987143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1f6a26d5-649f-43a6-be13-235ddf3fd800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:27.987695 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1f6a26d5-649f-43a6-be13-235ddf3fd800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:27.989526 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1126/2228] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:29:27 2022] DELETE /identity/v3/projects/b0d6bd7a00f24805b6ac961c4f766be6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:29:27.995054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776978c-1077-434f-adfc-e6604424dc8d None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:27.995546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776978c-1077-434f-adfc-e6604424dc8d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:27.996051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776978c-1077-434f-adfc-e6604424dc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:28.025875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-5776978c-1077-434f-adfc-e6604424dc8d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:28.027099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-5776978c-1077-434f-adfc-e6604424dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:28.139209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1103/2229] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:29:28.148572 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549da219-6fe6-4698-9bdb-1788a60230c9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:28.148870 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549da219-6fe6-4698-9bdb-1788a60230c9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:28.149148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549da219-6fe6-4698-9bdb-1788a60230c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:28.175034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-549da219-6fe6-4698-9bdb-1788a60230c9 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:28.176752 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-549da219-6fe6-4698-9bdb-1788a60230c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:28.186527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1127/2230] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:28.190750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776978c-1077-434f-adfc-e6604424dc8d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:28.204724 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776978c-1077-434f-adfc-e6604424dc8d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:28.210770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbe471-c24d-4350-894f-c42e95de4616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:28.211487 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbe471-c24d-4350-894f-c42e95de4616 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:28.211773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbe471-c24d-4350-894f-c42e95de4616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:28.212073 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbe471-c24d-4350-894f-c42e95de4616 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:28.212802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbe471-c24d-4350-894f-c42e95de4616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:29:28.213196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbe471-c24d-4350-894f-c42e95de4616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:28.214739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbe471-c24d-4350-894f-c42e95de4616 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:28.227519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1104/2231] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:29:28.232017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549da219-6fe6-4698-9bdb-1788a60230c9 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:28.243119 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549da219-6fe6-4698-9bdb-1788a60230c9 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:28.247821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f6fe4-5a7f-4b22-9720-85275b135d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:28.248596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f6fe4-5a7f-4b22-9720-85275b135d4e admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:28.248882 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f6fe4-5a7f-4b22-9720-85275b135d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:28.249802 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f6fe4-5a7f-4b22-9720-85275b135d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:28.251101 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f6fe4-5a7f-4b22-9720-85275b135d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:28.253080 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f6fe4-5a7f-4b22-9720-85275b135d4e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:28.334475 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbe471-c24d-4350-894f-c42e95de4616 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:28.336795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1128/2232] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:29:28 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:29:28.349258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbe471-c24d-4350-894f-c42e95de4616 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:28.473000 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc009ca-68d8-4156-9177-bc6291a48348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:28.474294 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc009ca-68d8-4156-9177-bc6291a48348 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:28.474742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc009ca-68d8-4156-9177-bc6291a48348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:28.474993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc009ca-68d8-4156-9177-bc6291a48348 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:28.475761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc009ca-68d8-4156-9177-bc6291a48348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:28.478025 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc009ca-68d8-4156-9177-bc6291a48348 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:28.504104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1105/2233] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:29:28 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:29:28.507975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f6fe4-5a7f-4b22-9720-85275b135d4e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:28.517959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f6fe4-5a7f-4b22-9720-85275b135d4e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:28.522686 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da2dab-ef75-4392-92c7-65db09797c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:28.523866 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da2dab-ef75-4392-92c7-65db09797c17 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:28.524236 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da2dab-ef75-4392-92c7-65db09797c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:28.524694 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da2dab-ef75-4392-92c7-65db09797c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:28.525485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da2dab-ef75-4392-92c7-65db09797c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:28.527103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da2dab-ef75-4392-92c7-65db09797c17 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:28.538432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1129/2234] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:29:28.543953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc009ca-68d8-4156-9177-bc6291a48348 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:28.558078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc009ca-68d8-4156-9177-bc6291a48348 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:28.563833 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5c3bf-7a0a-4734-b839-2a939e098dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:28.564614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5c3bf-7a0a-4734-b839-2a939e098dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:28.564968 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5c3bf-7a0a-4734-b839-2a939e098dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:28.565867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5c3bf-7a0a-4734-b839-2a939e098dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:28.566420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5c3bf-7a0a-4734-b839-2a939e098dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:28.568423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5c3bf-7a0a-4734-b839-2a939e098dd7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:28.585462 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1106/2235] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:29:28.586724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da2dab-ef75-4392-92c7-65db09797c17 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:28.597950 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da2dab-ef75-4392-92c7-65db09797c17 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:28.603989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dccf58-3072-4204-a4f7-d644ca4bb449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:28.605097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dccf58-3072-4204-a4f7-d644ca4bb449 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:28.605497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dccf58-3072-4204-a4f7-d644ca4bb449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:28.605852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dccf58-3072-4204-a4f7-d644ca4bb449 admin admin] PATH_INFO: `/v3/projects/5bbb294517cc450bbd3eb010343efc05/users/b7d2ec7116bd42a5b65ab04f65d359a7/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:28.622981 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dccf58-3072-4204-a4f7-d644ca4bb449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bbb294517cc450bbd3eb010343efc05, user_id=b7d2ec7116bd42a5b65ab04f65d359a7, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:28.626074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dccf58-3072-4204-a4f7-d644ca4bb449 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:28.639897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1130/2236] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:29:28 2022] PUT /identity/v3/projects/5bbb294517cc450bbd3eb010343efc05/users/b7d2ec7116bd42a5b65ab04f65d359a7/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:29:28.652604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72eec3-0429-4c70-b503-581ef0c43548 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:28.653376 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72eec3-0429-4c70-b503-581ef0c43548 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:28.653658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72eec3-0429-4c70-b503-581ef0c43548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:28.684672 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-8a72eec3-0429-4c70-b503-581ef0c43548 None None] MFA Rules not processed for user `b7d2ec7116bd42a5b65ab04f65d359a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:28.685905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8a72eec3-0429-4c70-b503-581ef0c43548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:28.766059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1107/2237] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:28.772063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dccf58-3072-4204-a4f7-d644ca4bb449 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:28.773861 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-31dccf58-3072-4204-a4f7-d644ca4bb449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:28.834370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dccf58-3072-4204-a4f7-d644ca4bb449 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:28.841356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8b983-8f05-43fa-9d85-508c11c951da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:28.842065 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8b983-8f05-43fa-9d85-508c11c951da service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:28.842461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8b983-8f05-43fa-9d85-508c11c951da service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:28.842998 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b8b983-8f05-43fa-9d85-508c11c951da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:28.857355 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8b983-8f05-43fa-9d85-508c11c951da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:28.859923 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b8b983-8f05-43fa-9d85-508c11c951da service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:28.870508 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1131/2238] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:29:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:29:30.248320 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b7797-51af-4e24-9ca3-e3b46c14ea39 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:30.248925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b7797-51af-4e24-9ca3-e3b46c14ea39 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:30.248925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b7797-51af-4e24-9ca3-e3b46c14ea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:30.268214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a32b7797-51af-4e24-9ca3-e3b46c14ea39 None None] MFA Rules not processed for user `b7d2ec7116bd42a5b65ab04f65d359a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:30.269416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a32b7797-51af-4e24-9ca3-e3b46c14ea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:30.276290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1108/2239] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:32.723313 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8b983-8f05-43fa-9d85-508c11c951da service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:32.724748 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d1b8b983-8f05-43fa-9d85-508c11c951da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:32.837204 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b8b983-8f05-43fa-9d85-508c11c951da service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:32.843746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:32.845156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:32.845518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:32.845932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] PATH_INFO: `/v3/users/ac9e0387590d4ba3a1498ce3c9664d03` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:32.847881 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9e0387590d4ba3a1498ce3c9664d03)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:32.850550 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:32.898656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9e0387590d4ba3a1498ce3c9664d03'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:32.911215 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9e0387590d4ba3a1498ce3c9664d03'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:32.911981 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9e0387590d4ba3a1498ce3c9664d03'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:32.920142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9e0387590d4ba3a1498ce3c9664d03'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:32.927185 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9e0387590d4ba3a1498ce3c9664d03'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:32.933143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1132/2240] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:29:32 2022] DELETE /identity/v3/users/ac9e0387590d4ba3a1498ce3c9664d03 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:29:32.937773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a9a49-3c15-45f7-a853-d31f3a5345b1 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:32.938315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a9a49-3c15-45f7-a853-d31f3a5345b1 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:32.938315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a9a49-3c15-45f7-a853-d31f3a5345b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:33.011500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-b70a9a49-3c15-45f7-a853-d31f3a5345b1 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:33.013742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-b70a9a49-3c15-45f7-a853-d31f3a5345b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:33.094039 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1109/2241] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:33.104212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:33.105676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:33.205532 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3da59-c869-4868-b068-321511e823b3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:33.209135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7ff06-dc7a-4fd8-bac5-8ce0d6ac0c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:33.209768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ff06-dc7a-4fd8-bac5-8ce0d6ac0c2d service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:33.210054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ff06-dc7a-4fd8-bac5-8ce0d6ac0c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:33.210324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7ff06-dc7a-4fd8-bac5-8ce0d6ac0c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:33.219955 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7ff06-dc7a-4fd8-bac5-8ce0d6ac0c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:33.221113 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7ff06-dc7a-4fd8-bac5-8ce0d6ac0c2d service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:33.236035 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1133/2242] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:29:33.843168 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a9a49-3c15-45f7-a853-d31f3a5345b1 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:33.844966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-b70a9a49-3c15-45f7-a853-d31f3a5345b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:33.857373 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a9a49-3c15-45f7-a853-d31f3a5345b1 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:33.863026 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363872cd-dcff-4367-9f0a-ec591d64e4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:33.864060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363872cd-dcff-4367-9f0a-ec591d64e4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:33.864449 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363872cd-dcff-4367-9f0a-ec591d64e4df admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:33.864606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363872cd-dcff-4367-9f0a-ec591d64e4df admin admin] PATH_INFO: `/v3/projects/a3d8559254684c6e863af74d6b54f49a` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:33.865809 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363872cd-dcff-4367-9f0a-ec591d64e4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d8559254684c6e863af74d6b54f49a)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:33.867738 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363872cd-dcff-4367-9f0a-ec591d64e4df admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:33.927025 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-363872cd-dcff-4367-9f0a-ec591d64e4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d8559254684c6e863af74d6b54f49a', 'request_id': 'req-363872cd-dcff-4367-9f0a-ec591d64e4df'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:33.932600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-363872cd-dcff-4367-9f0a-ec591d64e4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d8559254684c6e863af74d6b54f49a', 'request_id': 'req-363872cd-dcff-4367-9f0a-ec591d64e4df'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:33.939197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-363872cd-dcff-4367-9f0a-ec591d64e4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d8559254684c6e863af74d6b54f49a', 'request_id': 'req-363872cd-dcff-4367-9f0a-ec591d64e4df'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:33.951586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-363872cd-dcff-4367-9f0a-ec591d64e4df admin admin] The token cache is being invalidate because project a3d8559254684c6e863af74d6b54f49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:29:33.952003 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-363872cd-dcff-4367-9f0a-ec591d64e4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:33.952789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-363872cd-dcff-4367-9f0a-ec591d64e4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:33.954979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1110/2243] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:29:33 2022] DELETE /identity/v3/projects/a3d8559254684c6e863af74d6b54f49a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:29:34.756748 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351c503-712f-4bb8-88b3-4b96a228270a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:34.757268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351c503-712f-4bb8-88b3-4b96a228270a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:34.757369 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351c503-712f-4bb8-88b3-4b96a228270a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:34.774724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a351c503-712f-4bb8-88b3-4b96a228270a None None] MFA Rules not processed for user `e277c102c82b412481a8a9f888f4a7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:34.775905 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a351c503-712f-4bb8-88b3-4b96a228270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:34.827108 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1134/2244] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:42.548892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a646563-3fa9-4754-a14d-974ab7606fd2 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:42.549424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a646563-3fa9-4754-a14d-974ab7606fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:42.549424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a646563-3fa9-4754-a14d-974ab7606fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:42.571713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-2a646563-3fa9-4754-a14d-974ab7606fd2 None None] MFA Rules not processed for user `c4ce46898b1540fc98c6a6cf1e6b87b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:42.572956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2a646563-3fa9-4754-a14d-974ab7606fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:42.628417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1111/2245] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:55.194816 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987d216-1c69-43e9-a725-04754cdcc217 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:55.195308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987d216-1c69-43e9-a725-04754cdcc217 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:55.195401 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987d216-1c69-43e9-a725-04754cdcc217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:55.223613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-6987d216-1c69-43e9-a725-04754cdcc217 None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:55.224984 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6987d216-1c69-43e9-a725-04754cdcc217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:55.287212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1135/2246] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:29:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:55.299269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a646563-3fa9-4754-a14d-974ab7606fd2 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:55.300940 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2a646563-3fa9-4754-a14d-974ab7606fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:55.370901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a646563-3fa9-4754-a14d-974ab7606fd2 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:55.376181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df89918-7dbd-4b52-93c8-06847651f607 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:55.376820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89918-7dbd-4b52-93c8-06847651f607 service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:55.377104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89918-7dbd-4b52-93c8-06847651f607 service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:55.377382 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df89918-7dbd-4b52-93c8-06847651f607 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:55.385273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df89918-7dbd-4b52-93c8-06847651f607 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:55.386850 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df89918-7dbd-4b52-93c8-06847651f607 service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:55.395734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1112/2247] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:29:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:29:55.930654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8b218-509f-46fb-97c1-03bc3aca13e5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:55.930976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8b218-509f-46fb-97c1-03bc3aca13e5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:55.931252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8b218-509f-46fb-97c1-03bc3aca13e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:55.948566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-51b8b218-509f-46fb-97c1-03bc3aca13e5 None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:55.949683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-51b8b218-509f-46fb-97c1-03bc3aca13e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:55.957418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1136/2248] 10.222.0.90 () {58 vars in 967 bytes} [Wed Feb 16 09:29:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:55.970651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df89918-7dbd-4b52-93c8-06847651f607 service swift] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:55.980938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df89918-7dbd-4b52-93c8-06847651f607 service swift] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:55.986563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0af1e1-d0d9-45a3-8400-ac884dee5096 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:55.987272 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0af1e1-d0d9-45a3-8400-ac884dee5096 service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:55.987561 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0af1e1-d0d9-45a3-8400-ac884dee5096 service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:55.987892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0af1e1-d0d9-45a3-8400-ac884dee5096 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:55.996243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0af1e1-d0d9-45a3-8400-ac884dee5096 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:55.997807 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0af1e1-d0d9-45a3-8400-ac884dee5096 service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:56.006326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1113/2249] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:29:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:29:56.210053 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160be17-a912-47f8-8b80-e3678912cf7b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:56.210584 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160be17-a912-47f8-8b80-e3678912cf7b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:56.210727 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160be17-a912-47f8-8b80-e3678912cf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:56.230889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f160be17-a912-47f8-8b80-e3678912cf7b None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:56.232142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f160be17-a912-47f8-8b80-e3678912cf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:56.240110 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1137/2250] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:29:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:56.252617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0af1e1-d0d9-45a3-8400-ac884dee5096 service swift] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:56.262852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0af1e1-d0d9-45a3-8400-ac884dee5096 service swift] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:56.269413 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7364a0-d8a0-45b4-aee2-4971af32f282 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:56.270038 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7364a0-d8a0-45b4-aee2-4971af32f282 service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:56.270320 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7364a0-d8a0-45b4-aee2-4971af32f282 service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:56.270595 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7364a0-d8a0-45b4-aee2-4971af32f282 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:56.278415 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7364a0-d8a0-45b4-aee2-4971af32f282 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:56.280277 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7364a0-d8a0-45b4-aee2-4971af32f282 service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:56.289646 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1114/2251] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:29:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:29:56.615270 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2eb5d-2e11-4052-b056-b35414d44c13 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:56.615556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2eb5d-2e11-4052-b056-b35414d44c13 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:56.615832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2eb5d-2e11-4052-b056-b35414d44c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:56.635502 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-35b2eb5d-2e11-4052-b056-b35414d44c13 None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:56.636709 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-35b2eb5d-2e11-4052-b056-b35414d44c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:56.644442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1138/2252] 10.222.0.90 () {58 vars in 967 bytes} [Wed Feb 16 09:29:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:56.656885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7364a0-d8a0-45b4-aee2-4971af32f282 service swift] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:56.667083 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7364a0-d8a0-45b4-aee2-4971af32f282 service swift] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:56.672898 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6d156-b6a2-4fdd-a5f7-eedec5a53bac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:56.673866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6d156-b6a2-4fdd-a5f7-eedec5a53bac service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:56.674151 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6d156-b6a2-4fdd-a5f7-eedec5a53bac service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:56.674421 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6d156-b6a2-4fdd-a5f7-eedec5a53bac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:56.682875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6d156-b6a2-4fdd-a5f7-eedec5a53bac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:56.684503 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6d156-b6a2-4fdd-a5f7-eedec5a53bac service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:56.693841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1115/2253] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:29:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:29:58.413234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2eb5d-2e11-4052-b056-b35414d44c13 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:58.414662 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-35b2eb5d-2e11-4052-b056-b35414d44c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:58.470173 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2eb5d-2e11-4052-b056-b35414d44c13 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:58.473655 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7278baa-5f56-4be1-96bd-a6b790f98c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:58.474286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7278baa-5f56-4be1-96bd-a6b790f98c9d service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:58.474565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7278baa-5f56-4be1-96bd-a6b790f98c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:58.474839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7278baa-5f56-4be1-96bd-a6b790f98c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:58.476617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f7278baa-5f56-4be1-96bd-a6b790f98c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:58.539322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7278baa-5f56-4be1-96bd-a6b790f98c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:58.541225 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7278baa-5f56-4be1-96bd-a6b790f98c9d service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:58.556144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1139/2254] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:29:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:29:58.900366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6d156-b6a2-4fdd-a5f7-eedec5a53bac service swift] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:58.901872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-bce6d156-b6a2-4fdd-a5f7-eedec5a53bac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:59.000686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6d156-b6a2-4fdd-a5f7-eedec5a53bac service swift] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:59.005447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:59.006348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:59.006620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:59.006892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] PATH_INFO: `/v3/users/b7d2ec7116bd42a5b65ab04f65d359a7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:59.012117 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d2ec7116bd42a5b65ab04f65d359a7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:59.012117 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:59.082737 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d2ec7116bd42a5b65ab04f65d359a7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:59.098287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d2ec7116bd42a5b65ab04f65d359a7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:59.107057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d2ec7116bd42a5b65ab04f65d359a7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:59.116134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d2ec7116bd42a5b65ab04f65d359a7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:59.117004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d2ec7116bd42a5b65ab04f65d359a7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:59.123717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1116/2255] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:29:58 2022] DELETE /identity/v3/users/b7d2ec7116bd42a5b65ab04f65d359a7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:29:59.128757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462f5f1-b0bf-4702-801f-780cff0deeec None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:59.129102 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462f5f1-b0bf-4702-801f-780cff0deeec None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:59.129610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462f5f1-b0bf-4702-801f-780cff0deeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:59.151876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a462f5f1-b0bf-4702-801f-780cff0deeec None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:29:59.153487 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a462f5f1-b0bf-4702-801f-780cff0deeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:59.225248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1140/2256] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:29:59.232050 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:59.233690 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:59.317735 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d66a828-235b-4116-aa2e-123629fa7dc6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:59.325329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3099b07-8a09-4752-ae06-f4a2e9c46d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:59.326789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3099b07-8a09-4752-ae06-f4a2e9c46d9e service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:59.327172 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3099b07-8a09-4752-ae06-f4a2e9c46d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:59.327552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3099b07-8a09-4752-ae06-f4a2e9c46d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:59.349682 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3099b07-8a09-4752-ae06-f4a2e9c46d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:59.349682 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3099b07-8a09-4752-ae06-f4a2e9c46d9e service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:59.360363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1117/2257] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:29:59.634732 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462f5f1-b0bf-4702-801f-780cff0deeec None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:29:59.637246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a462f5f1-b0bf-4702-801f-780cff0deeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:29:59.651325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462f5f1-b0bf-4702-801f-780cff0deeec None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:29:59.658709 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:29:59.660287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:29:59.660800 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:29:59.661267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b admin admin] PATH_INFO: `/v3/projects/5bbb294517cc450bbd3eb010343efc05` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:29:59.662882 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bbb294517cc450bbd3eb010343efc05)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:29:59.665702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:29:59.723690 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bbb294517cc450bbd3eb010343efc05', 'request_id': 'req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:59.729036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bbb294517cc450bbd3eb010343efc05', 'request_id': 'req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:59.735559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bbb294517cc450bbd3eb010343efc05', 'request_id': 'req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:59.750022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b admin admin] The token cache is being invalidate because project 5bbb294517cc450bbd3eb010343efc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:29:59.750421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:59.751157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c1486cf0-53ff-4d6a-9901-1b82b90aa26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:29:59.752870 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1141/2258] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:29:59 2022] DELETE /identity/v3/projects/5bbb294517cc450bbd3eb010343efc05 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:30:04.079324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3099b07-8a09-4752-ae06-f4a2e9c46d9e service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:30:04.088181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3099b07-8a09-4752-ae06-f4a2e9c46d9e service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:30:04.140113 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155562-ddcc-45c1-ad3a-9053ebf65fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:30:04.141902 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155562-ddcc-45c1-ad3a-9053ebf65fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:04.142187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155562-ddcc-45c1-ad3a-9053ebf65fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:04.142465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11155562-ddcc-45c1-ad3a-9053ebf65fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:04.144329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-11155562-ddcc-45c1-ad3a-9053ebf65fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:04.208326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155562-ddcc-45c1-ad3a-9053ebf65fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:30:04.209783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11155562-ddcc-45c1-ad3a-9053ebf65fd0 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:30:04.220979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1118/2259] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:30:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:30:05.865818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec206f22-ebab-45ea-8708-53658569a651 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:05.866738 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec206f22-ebab-45ea-8708-53658569a651 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:05.867023 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec206f22-ebab-45ea-8708-53658569a651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:05.888736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ec206f22-ebab-45ea-8708-53658569a651 None None] MFA Rules not processed for user `c4ce46898b1540fc98c6a6cf1e6b87b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:30:05.891354 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ec206f22-ebab-45ea-8708-53658569a651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:05.958986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1142/2260] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:30:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:30:16.842367 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155562-ddcc-45c1-ad3a-9053ebf65fd0 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:30:16.843801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-11155562-ddcc-45c1-ad3a-9053ebf65fd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:16.946408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11155562-ddcc-45c1-ad3a-9053ebf65fd0 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:30:16.952377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dde987-f558-42e0-bf22-d855b8bae195 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d870fbd90cb4fde9ceafd2b737795eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:30:16.952905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dde987-f558-42e0-bf22-d855b8bae195 service placement] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:16.953220 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dde987-f558-42e0-bf22-d855b8bae195 service placement] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:16.953468 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dde987-f558-42e0-bf22-d855b8bae195 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:16.955605 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d3dde987-f558-42e0-bf22-d855b8bae195 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:16.967355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dde987-f558-42e0-bf22-d855b8bae195 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:30:16.968973 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dde987-f558-42e0-bf22-d855b8bae195 service placement] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:30:16.979754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1119/2261] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:30:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:30:37.047062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c098b-f9ee-45d9-bdeb-7e463c7781eb None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:37.047886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c098b-f9ee-45d9-bdeb-7e463c7781eb None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:37.048207 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c098b-f9ee-45d9-bdeb-7e463c7781eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:37.100097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b02c098b-f9ee-45d9-bdeb-7e463c7781eb None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:30:37.101469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b02c098b-f9ee-45d9-bdeb-7e463c7781eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:37.181832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1143/2262] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:30:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:30:37.204196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dde987-f558-42e0-bf22-d855b8bae195 service placement] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:30:37.205927 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d3dde987-f558-42e0-bf22-d855b8bae195 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:37.304244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dde987-f558-42e0-bf22-d855b8bae195 service placement] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:30:37.309257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6e815-d442-4060-9173-f9c30e75733a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:30:37.309901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6e815-d442-4060-9173-f9c30e75733a service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:37.310180 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6e815-d442-4060-9173-f9c30e75733a service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:37.310449 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6e815-d442-4060-9173-f9c30e75733a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:37.319760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6e815-d442-4060-9173-f9c30e75733a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:30:37.321372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6e815-d442-4060-9173-f9c30e75733a service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:30:37.329365 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1120/2263] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:30:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:30:45.651440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9be6bf-1590-44d8-9747-50e477ad1a8e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:45.652086 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9be6bf-1590-44d8-9747-50e477ad1a8e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:45.652086 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9be6bf-1590-44d8-9747-50e477ad1a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:45.675022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5e9be6bf-1590-44d8-9747-50e477ad1a8e None None] MFA Rules not processed for user `c4ce46898b1540fc98c6a6cf1e6b87b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:30:45.676339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5e9be6bf-1590-44d8-9747-50e477ad1a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:45.683972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1144/2264] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:30:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:30:55.306064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55b54f-ca47-4647-9836-a84ec3f35958 None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:55.306727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55b54f-ca47-4647-9836-a84ec3f35958 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:55.306727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55b54f-ca47-4647-9836-a84ec3f35958 None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:55.308469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1121/2265] 10.222.0.90 () {54 vars in 921 bytes} [Wed Feb 16 09:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:30:55.315545 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd7a06-54c8-4dc6-a222-c8cd7442c570 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:55.316135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd7a06-54c8-4dc6-a222-c8cd7442c570 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:55.316246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd7a06-54c8-4dc6-a222-c8cd7442c570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:55.380866 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-19dd7a06-54c8-4dc6-a222-c8cd7442c570 None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:30:55.382207 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-19dd7a06-54c8-4dc6-a222-c8cd7442c570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:55.472546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1145/2266] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Feb 16 09:30:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:30:55.484208 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55b54f-ca47-4647-9836-a84ec3f35958 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:30:55.485884 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-dd55b54f-ca47-4647-9836-a84ec3f35958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:55.563472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55b54f-ca47-4647-9836-a84ec3f35958 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:30:55.567492 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a126dba-7951-4e1e-b88f-186745d41895 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5074090dca0b4a49b54dc252a5dd9420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:30:55.568166 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a126dba-7951-4e1e-b88f-186745d41895 service glance] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:55.568453 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a126dba-7951-4e1e-b88f-186745d41895 service glance] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:55.568729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a126dba-7951-4e1e-b88f-186745d41895 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:55.579075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a126dba-7951-4e1e-b88f-186745d41895 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:30:55.581649 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a126dba-7951-4e1e-b88f-186745d41895 service glance] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:30:55.592099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1122/2267] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:30:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:30:55.661227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb682-9c42-4275-acfb-69ad27a2e9d8 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:55.661513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb682-9c42-4275-acfb-69ad27a2e9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:55.661791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bb682-9c42-4275-acfb-69ad27a2e9d8 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:55.663585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1146/2268] 10.222.0.90 () {54 vars in 921 bytes} [Wed Feb 16 09:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:30:55.668276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6d5d5-f2c0-495d-a7d1-80f008a909bb None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:55.668696 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6d5d5-f2c0-495d-a7d1-80f008a909bb None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:55.668849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6d5d5-f2c0-495d-a7d1-80f008a909bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:55.704393 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-67d6d5d5-f2c0-495d-a7d1-80f008a909bb None None] MFA Rules not processed for user `39d5d18c09054343b4e000950ba875fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:30:55.706293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-67d6d5d5-f2c0-495d-a7d1-80f008a909bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:55.713114 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1123/2269] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Feb 16 09:30:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:30:55.725089 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb682-9c42-4275-acfb-69ad27a2e9d8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:30:55.726750 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-160bb682-9c42-4275-acfb-69ad27a2e9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:55.739815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bb682-9c42-4275-acfb-69ad27a2e9d8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:30:55.743360 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd8881-8745-4ba3-9803-f22418335a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:30:55.743976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd8881-8745-4ba3-9803-f22418335a2f service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:55.744280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd8881-8745-4ba3-9803-f22418335a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:55.744554 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd8881-8745-4ba3-9803-f22418335a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:55.751446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd8881-8745-4ba3-9803-f22418335a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:30:55.753397 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd8881-8745-4ba3-9803-f22418335a2f service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:30:55.760747 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1147/2270] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:30:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:30:55.847355 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd74966-1f9c-4bd9-a481-f0f0450a277e None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:55.847849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd74966-1f9c-4bd9-a481-f0f0450a277e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:55.848165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd74966-1f9c-4bd9-a481-f0f0450a277e None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:55.849940 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1124/2271] 10.222.0.90 () {54 vars in 921 bytes} [Wed Feb 16 09:30:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:30:55.855412 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4e962-c561-4828-80e0-38562520555c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:55.855703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4e962-c561-4828-80e0-38562520555c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:55.855983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4e962-c561-4828-80e0-38562520555c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:55.874453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7eb4e962-c561-4828-80e0-38562520555c None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:30:55.875677 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7eb4e962-c561-4828-80e0-38562520555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:55.884954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1148/2272] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Feb 16 09:30:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:30:55.895912 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd74966-1f9c-4bd9-a481-f0f0450a277e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:30:55.907668 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd74966-1f9c-4bd9-a481-f0f0450a277e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:30:55.912082 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf76dcf-585f-4ca8-91a9-8d82010e5fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:30:55.912743 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf76dcf-585f-4ca8-91a9-8d82010e5fde service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:55.913020 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf76dcf-585f-4ca8-91a9-8d82010e5fde service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:55.913317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf76dcf-585f-4ca8-91a9-8d82010e5fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:55.923265 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf76dcf-585f-4ca8-91a9-8d82010e5fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:30:55.925057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf76dcf-585f-4ca8-91a9-8d82010e5fde service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:30:55.935598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1125/2273] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:30:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:30:59.844872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc7151-c673-4dd8-ac64-f7dcf2e93695 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:59.845378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc7151-c673-4dd8-ac64-f7dcf2e93695 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:59.845486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc7151-c673-4dd8-ac64-f7dcf2e93695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:59.863648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-d1dc7151-c673-4dd8-ac64-f7dcf2e93695 None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:30:59.864875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d1dc7151-c673-4dd8-ac64-f7dcf2e93695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:30:59.871961 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1149/2274] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:30:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:30:59.883930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf76dcf-585f-4ca8-91a9-8d82010e5fde service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:30:59.895280 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf76dcf-585f-4ca8-91a9-8d82010e5fde service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:30:59.900239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb5cc9-c46b-44d8-a11e-3657d2dd2062 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:30:59.900875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb5cc9-c46b-44d8-a11e-3657d2dd2062 service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:30:59.901154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb5cc9-c46b-44d8-a11e-3657d2dd2062 service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:30:59.901430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb5cc9-c46b-44d8-a11e-3657d2dd2062 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:30:59.910807 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb5cc9-c46b-44d8-a11e-3657d2dd2062 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:30:59.912531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb5cc9-c46b-44d8-a11e-3657d2dd2062 service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:30:59.920597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1126/2275] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:30:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:31:42.996808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bd83c-8c92-4f2b-bdea-71338b1596eb None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:31:42.997335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bd83c-8c92-4f2b-bdea-71338b1596eb None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:31:42.997335 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484bd83c-8c92-4f2b-bdea-71338b1596eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:31:43.014837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-484bd83c-8c92-4f2b-bdea-71338b1596eb None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:31:43.016052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-484bd83c-8c92-4f2b-bdea-71338b1596eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:31:43.024731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1150/2276] 10.222.0.90 () {58 vars in 967 bytes} [Wed Feb 16 09:31:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:31:43.047188 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb5cc9-c46b-44d8-a11e-3657d2dd2062 service swift] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:31:43.057617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb5cc9-c46b-44d8-a11e-3657d2dd2062 service swift] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:31:43.062558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf31ca-6fa3-4208-be00-53e223ba67cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:31:43.063181 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf31ca-6fa3-4208-be00-53e223ba67cd service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:31:43.063459 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf31ca-6fa3-4208-be00-53e223ba67cd service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:31:43.063732 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf31ca-6fa3-4208-be00-53e223ba67cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:31:43.072032 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf31ca-6fa3-4208-be00-53e223ba67cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:31:43.073614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf31ca-6fa3-4208-be00-53e223ba67cd service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:31:43.081381 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1127/2277] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:31:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:32:07.180487 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bd83c-8c92-4f2b-bdea-71338b1596eb None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:07.182062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-484bd83c-8c92-4f2b-bdea-71338b1596eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:07.244680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484bd83c-8c92-4f2b-bdea-71338b1596eb None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:07.249189 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f294ea5-c703-422c-9919-4cb6e28d722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:07.250046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f294ea5-c703-422c-9919-4cb6e28d722a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:07.250325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f294ea5-c703-422c-9919-4cb6e28d722a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:07.250599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f294ea5-c703-422c-9919-4cb6e28d722a admin admin] PATH_INFO: `/v3/users/c4ce46898b1540fc98c6a6cf1e6b87b9` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:07.251790 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f294ea5-c703-422c-9919-4cb6e28d722a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ce46898b1540fc98c6a6cf1e6b87b9)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:07.253764 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f294ea5-c703-422c-9919-4cb6e28d722a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:07.298375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9f294ea5-c703-422c-9919-4cb6e28d722a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ce46898b1540fc98c6a6cf1e6b87b9'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:07.309902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9f294ea5-c703-422c-9919-4cb6e28d722a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ce46898b1540fc98c6a6cf1e6b87b9'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:07.310578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9f294ea5-c703-422c-9919-4cb6e28d722a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ce46898b1540fc98c6a6cf1e6b87b9'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:07.317161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9f294ea5-c703-422c-9919-4cb6e28d722a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ce46898b1540fc98c6a6cf1e6b87b9'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:07.323971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9f294ea5-c703-422c-9919-4cb6e28d722a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ce46898b1540fc98c6a6cf1e6b87b9'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:07.329722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1151/2278] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:07 2022] DELETE /identity/v3/users/c4ce46898b1540fc98c6a6cf1e6b87b9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:32:07.496350 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf31ca-6fa3-4208-be00-53e223ba67cd service swift] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:07.510251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf31ca-6fa3-4208-be00-53e223ba67cd service swift] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:07.579325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88885de-d3d1-4666-815a-e9e60f3663bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:07.580249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88885de-d3d1-4666-815a-e9e60f3663bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:07.580536 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88885de-d3d1-4666-815a-e9e60f3663bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:07.580815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88885de-d3d1-4666-815a-e9e60f3663bd admin admin] PATH_INFO: `/v3/projects/06161d2bb1bc42e6aa6d5273574be351` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:07.581999 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88885de-d3d1-4666-815a-e9e60f3663bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=06161d2bb1bc42e6aa6d5273574be351)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:07.583936 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88885de-d3d1-4666-815a-e9e60f3663bd admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:07.631496 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c88885de-d3d1-4666-815a-e9e60f3663bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06161d2bb1bc42e6aa6d5273574be351', 'request_id': 'req-c88885de-d3d1-4666-815a-e9e60f3663bd'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:07.637625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c88885de-d3d1-4666-815a-e9e60f3663bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06161d2bb1bc42e6aa6d5273574be351', 'request_id': 'req-c88885de-d3d1-4666-815a-e9e60f3663bd'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:07.645746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c88885de-d3d1-4666-815a-e9e60f3663bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06161d2bb1bc42e6aa6d5273574be351', 'request_id': 'req-c88885de-d3d1-4666-815a-e9e60f3663bd'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:07.661645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c88885de-d3d1-4666-815a-e9e60f3663bd admin admin] The token cache is being invalidate because project 06161d2bb1bc42e6aa6d5273574be351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:07.661940 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c88885de-d3d1-4666-815a-e9e60f3663bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:07.662596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c88885de-d3d1-4666-815a-e9e60f3663bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:07.664606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1128/2279] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:07 2022] DELETE /identity/v3/projects/06161d2bb1bc42e6aa6d5273574be351 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:32:07.669312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a01e66-7452-49b1-961e-5751a46b693d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:07.669880 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a01e66-7452-49b1-961e-5751a46b693d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:07.670223 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a01e66-7452-49b1-961e-5751a46b693d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:07.709509 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a1a01e66-7452-49b1-961e-5751a46b693d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:07.711650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a1a01e66-7452-49b1-961e-5751a46b693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:07.770870 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1152/2280] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:07.778715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03d211-d296-4803-be5c-a240dc68240b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:07.779028 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03d211-d296-4803-be5c-a240dc68240b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:07.779328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03d211-d296-4803-be5c-a240dc68240b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:07.797765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-5c03d211-d296-4803-be5c-a240dc68240b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:07.798954 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-5c03d211-d296-4803-be5c-a240dc68240b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:07.807750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1129/2281] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:07.812144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a01e66-7452-49b1-961e-5751a46b693d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:07.821811 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a01e66-7452-49b1-961e-5751a46b693d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:07.827737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164f08-6ff2-4fa5-a520-fd9dbc7dd88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:07.828430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164f08-6ff2-4fa5-a520-fd9dbc7dd88e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:07.828714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164f08-6ff2-4fa5-a520-fd9dbc7dd88e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:07.828991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed164f08-6ff2-4fa5-a520-fd9dbc7dd88e admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:07.829710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed164f08-6ff2-4fa5-a520-fd9dbc7dd88e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:32:07.830019 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed164f08-6ff2-4fa5-a520-fd9dbc7dd88e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:07.831608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed164f08-6ff2-4fa5-a520-fd9dbc7dd88e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:07.844475 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1153/2282] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:32:07.848845 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03d211-d296-4803-be5c-a240dc68240b None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:07.858666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03d211-d296-4803-be5c-a240dc68240b None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:07.863253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c192d-ed75-48a4-93ba-c187dea96f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:07.863893 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c192d-ed75-48a4-93ba-c187dea96f55 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:07.864210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c192d-ed75-48a4-93ba-c187dea96f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:07.864485 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c192d-ed75-48a4-93ba-c187dea96f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:07.865166 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c192d-ed75-48a4-93ba-c187dea96f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:07.867226 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c192d-ed75-48a4-93ba-c187dea96f55 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:07.891482 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1130/2283] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:07 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:07.896582 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164f08-6ff2-4fa5-a520-fd9dbc7dd88e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:07.909212 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed164f08-6ff2-4fa5-a520-fd9dbc7dd88e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:07.964666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13280435-ec25-4351-91fa-f7550d73391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:07.965339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13280435-ec25-4351-91fa-f7550d73391c admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:07.965624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13280435-ec25-4351-91fa-f7550d73391c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:07.965910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13280435-ec25-4351-91fa-f7550d73391c admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:07.966627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13280435-ec25-4351-91fa-f7550d73391c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:07.968614 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13280435-ec25-4351-91fa-f7550d73391c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:07.989010 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1154/2284] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:07 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:07.993388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c192d-ed75-48a4-93ba-c187dea96f55 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:08.003582 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c192d-ed75-48a4-93ba-c187dea96f55 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:08.008480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77949ca7-8c46-43f9-926a-2338bc865578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:08.009134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77949ca7-8c46-43f9-926a-2338bc865578 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:08.009422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77949ca7-8c46-43f9-926a-2338bc865578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:08.009703 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77949ca7-8c46-43f9-926a-2338bc865578 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:08.010511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77949ca7-8c46-43f9-926a-2338bc865578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:08.012037 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77949ca7-8c46-43f9-926a-2338bc865578 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:08.023901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1131/2285] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:08.027866 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13280435-ec25-4351-91fa-f7550d73391c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:08.038712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13280435-ec25-4351-91fa-f7550d73391c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:08.043392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08156ad0-93f4-455b-8122-95261ae542a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:08.044100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08156ad0-93f4-455b-8122-95261ae542a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:08.044380 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08156ad0-93f4-455b-8122-95261ae542a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:08.044653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08156ad0-93f4-455b-8122-95261ae542a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:08.045364 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08156ad0-93f4-455b-8122-95261ae542a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:08.046964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08156ad0-93f4-455b-8122-95261ae542a0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:08.056719 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1155/2286] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:08.060964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77949ca7-8c46-43f9-926a-2338bc865578 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:08.070756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77949ca7-8c46-43f9-926a-2338bc865578 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:08.075352 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc69df-0854-47dc-ba9e-86e85429d4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:08.076253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc69df-0854-47dc-ba9e-86e85429d4f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:08.076533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc69df-0854-47dc-ba9e-86e85429d4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:08.076807 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc69df-0854-47dc-ba9e-86e85429d4f3 admin admin] PATH_INFO: `/v3/projects/63daaf26cc99412a963a1e35e2027468/users/2a3bccf9fdc541ddb73724de7910621a/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:08.091209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc69df-0854-47dc-ba9e-86e85429d4f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63daaf26cc99412a963a1e35e2027468, user_id=2a3bccf9fdc541ddb73724de7910621a, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:08.093890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc69df-0854-47dc-ba9e-86e85429d4f3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:08.120346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1132/2287] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:08 2022] PUT /identity/v3/projects/63daaf26cc99412a963a1e35e2027468/users/2a3bccf9fdc541ddb73724de7910621a/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:08.130205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38280a-1e6e-4af5-8c1e-8dcfcb056db3 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:08.130500 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38280a-1e6e-4af5-8c1e-8dcfcb056db3 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:08.130782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38280a-1e6e-4af5-8c1e-8dcfcb056db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:08.158084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0a38280a-1e6e-4af5-8c1e-8dcfcb056db3 None None] MFA Rules not processed for user `2a3bccf9fdc541ddb73724de7910621a`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:08.159283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0a38280a-1e6e-4af5-8c1e-8dcfcb056db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:08.219687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1156/2288] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:08.230221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc69df-0854-47dc-ba9e-86e85429d4f3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:08.231901 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9dbc69df-0854-47dc-ba9e-86e85429d4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:08.301692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc69df-0854-47dc-ba9e-86e85429d4f3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:08.307518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694b282-8bf0-4c6d-8695-085abb5d8649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:08.308182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694b282-8bf0-4c6d-8695-085abb5d8649 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:08.308469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694b282-8bf0-4c6d-8695-085abb5d8649 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:08.308747 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694b282-8bf0-4c6d-8695-085abb5d8649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:08.316397 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694b282-8bf0-4c6d-8695-085abb5d8649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:08.317962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694b282-8bf0-4c6d-8695-085abb5d8649 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:08.327109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1133/2289] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:10.960278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38280a-1e6e-4af5-8c1e-8dcfcb056db3 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:11.021321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a38280a-1e6e-4af5-8c1e-8dcfcb056db3 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:11.026150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:11.027011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:11.027294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:11.027569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] PATH_INFO: `/v3/users/2a3bccf9fdc541ddb73724de7910621a` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:11.028782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3bccf9fdc541ddb73724de7910621a)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:11.030697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:11.085344 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3bccf9fdc541ddb73724de7910621a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:11.098781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3bccf9fdc541ddb73724de7910621a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:11.099517 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3bccf9fdc541ddb73724de7910621a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:11.108733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3bccf9fdc541ddb73724de7910621a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:11.116064 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3bccf9fdc541ddb73724de7910621a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:11.122341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1157/2290] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:10 2022] DELETE /identity/v3/users/2a3bccf9fdc541ddb73724de7910621a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:11.126796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d48a71-7a0a-49b9-8602-992dbf4af68c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:11.127289 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d48a71-7a0a-49b9-8602-992dbf4af68c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:11.127394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d48a71-7a0a-49b9-8602-992dbf4af68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:11.145107 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-f2d48a71-7a0a-49b9-8602-992dbf4af68c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:11.146288 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f2d48a71-7a0a-49b9-8602-992dbf4af68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:11.215506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1134/2291] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:11.223408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:11.226031 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:11.287707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d99bb-9701-4dfc-a447-5e5a069e8fcf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:11.292675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae72ba3-aa72-4b08-8655-571e38fdb7fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:11.294046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae72ba3-aa72-4b08-8655-571e38fdb7fd service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:11.294332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae72ba3-aa72-4b08-8655-571e38fdb7fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:11.294615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae72ba3-aa72-4b08-8655-571e38fdb7fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:11.305391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae72ba3-aa72-4b08-8655-571e38fdb7fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:11.307147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae72ba3-aa72-4b08-8655-571e38fdb7fd service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:11.318295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1158/2292] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:11.658267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d48a71-7a0a-49b9-8602-992dbf4af68c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:11.659771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f2d48a71-7a0a-49b9-8602-992dbf4af68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:11.673396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d48a71-7a0a-49b9-8602-992dbf4af68c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:11.679275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c8268-c45e-444f-9532-48f5f04c445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:11.680219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c8268-c45e-444f-9532-48f5f04c445b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:11.680450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c8268-c45e-444f-9532-48f5f04c445b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:11.680761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c8268-c45e-444f-9532-48f5f04c445b admin admin] PATH_INFO: `/v3/projects/63daaf26cc99412a963a1e35e2027468` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:11.682016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c8268-c45e-444f-9532-48f5f04c445b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63daaf26cc99412a963a1e35e2027468)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:11.683956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c8268-c45e-444f-9532-48f5f04c445b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:11.728917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3a3c8268-c45e-444f-9532-48f5f04c445b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63daaf26cc99412a963a1e35e2027468', 'request_id': 'req-3a3c8268-c45e-444f-9532-48f5f04c445b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:11.734019 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3a3c8268-c45e-444f-9532-48f5f04c445b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63daaf26cc99412a963a1e35e2027468', 'request_id': 'req-3a3c8268-c45e-444f-9532-48f5f04c445b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:11.740262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3a3c8268-c45e-444f-9532-48f5f04c445b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63daaf26cc99412a963a1e35e2027468', 'request_id': 'req-3a3c8268-c45e-444f-9532-48f5f04c445b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:11.753646 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3a3c8268-c45e-444f-9532-48f5f04c445b admin admin] The token cache is being invalidate because project 63daaf26cc99412a963a1e35e2027468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:11.753930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3a3c8268-c45e-444f-9532-48f5f04c445b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:11.754586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3a3c8268-c45e-444f-9532-48f5f04c445b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:11.756210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1135/2293] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:11 2022] DELETE /identity/v3/projects/63daaf26cc99412a963a1e35e2027468 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:11.762161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ca9f2-0a89-4a60-942e-156e30b94923 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:11.762451 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ca9f2-0a89-4a60-942e-156e30b94923 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:11.762729 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ca9f2-0a89-4a60-942e-156e30b94923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:11.780185 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-392ca9f2-0a89-4a60-942e-156e30b94923 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:11.781385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-392ca9f2-0a89-4a60-942e-156e30b94923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:11.841081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1159/2294] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:11.849192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f0c33-7d1b-46f5-a1e7-7b75c82b0947 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:11.849480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f0c33-7d1b-46f5-a1e7-7b75c82b0947 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:11.849757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f0c33-7d1b-46f5-a1e7-7b75c82b0947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:11.869821 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-310f0c33-7d1b-46f5-a1e7-7b75c82b0947 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:11.871007 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-310f0c33-7d1b-46f5-a1e7-7b75c82b0947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:11.878969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1136/2295] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:11.883119 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ca9f2-0a89-4a60-942e-156e30b94923 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:11.892467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ca9f2-0a89-4a60-942e-156e30b94923 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:11.897055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a87811-a879-43c5-a93b-21b085481f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:11.897710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a87811-a879-43c5-a93b-21b085481f7d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:11.898131 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a87811-a879-43c5-a93b-21b085481f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:11.898413 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a87811-a879-43c5-a93b-21b085481f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:11.899126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a87811-a879-43c5-a93b-21b085481f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:32:11.899431 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a87811-a879-43c5-a93b-21b085481f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:11.901053 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a87811-a879-43c5-a93b-21b085481f7d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:11.912416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1160/2296] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:32:11.917941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f0c33-7d1b-46f5-a1e7-7b75c82b0947 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:11.927317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f0c33-7d1b-46f5-a1e7-7b75c82b0947 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:11.933008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68218f55-d1eb-48d2-9961-505a78d80ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:11.933645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68218f55-d1eb-48d2-9961-505a78d80ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:11.933921 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68218f55-d1eb-48d2-9961-505a78d80ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:11.934189 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68218f55-d1eb-48d2-9961-505a78d80ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:11.934872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68218f55-d1eb-48d2-9961-505a78d80ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:11.936913 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68218f55-d1eb-48d2-9961-505a78d80ab0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:11.960909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1137/2297] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:11 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:11.964967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a87811-a879-43c5-a93b-21b085481f7d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:11.974634 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a87811-a879-43c5-a93b-21b085481f7d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.030932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a117d-aacc-4594-8f5a-c79123ea30d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.031719 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a117d-aacc-4594-8f5a-c79123ea30d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.031939 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a117d-aacc-4594-8f5a-c79123ea30d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.032288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a117d-aacc-4594-8f5a-c79123ea30d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.033318 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a117d-aacc-4594-8f5a-c79123ea30d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:12.035442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a117d-aacc-4594-8f5a-c79123ea30d4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:12.056093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1161/2298] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:11 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:12.060076 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68218f55-d1eb-48d2-9961-505a78d80ab0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:12.071334 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68218f55-d1eb-48d2-9961-505a78d80ab0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.076016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912ad7b-2ece-4e1c-88d0-0f730a40638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.076715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912ad7b-2ece-4e1c-88d0-0f730a40638a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.076997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912ad7b-2ece-4e1c-88d0-0f730a40638a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.077395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912ad7b-2ece-4e1c-88d0-0f730a40638a admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.078138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912ad7b-2ece-4e1c-88d0-0f730a40638a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:12.079753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912ad7b-2ece-4e1c-88d0-0f730a40638a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:12.090978 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1138/2299] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:12.095024 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a117d-aacc-4594-8f5a-c79123ea30d4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:12.105336 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a117d-aacc-4594-8f5a-c79123ea30d4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.110031 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e994e0e-ed8d-4f04-a3c4-c14df1fd44d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.110819 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e994e0e-ed8d-4f04-a3c4-c14df1fd44d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.111180 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e994e0e-ed8d-4f04-a3c4-c14df1fd44d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.111437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e994e0e-ed8d-4f04-a3c4-c14df1fd44d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.112234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e994e0e-ed8d-4f04-a3c4-c14df1fd44d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:12.113848 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e994e0e-ed8d-4f04-a3c4-c14df1fd44d6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:12.124757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1162/2300] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:12.129408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912ad7b-2ece-4e1c-88d0-0f730a40638a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:12.140902 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912ad7b-2ece-4e1c-88d0-0f730a40638a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.146436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979e6e5-436b-42bf-919a-9507308e513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.147383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979e6e5-436b-42bf-919a-9507308e513c admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.147661 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979e6e5-436b-42bf-919a-9507308e513c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.148104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979e6e5-436b-42bf-919a-9507308e513c admin admin] PATH_INFO: `/v3/projects/c13f10bd1059418395411296467ae379/users/0aebc272f2854d79bb5de1090bfb3c99/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.165058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979e6e5-436b-42bf-919a-9507308e513c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13f10bd1059418395411296467ae379, user_id=0aebc272f2854d79bb5de1090bfb3c99, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:12.168207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979e6e5-436b-42bf-919a-9507308e513c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:12.181259 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1139/2301] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:12 2022] PUT /identity/v3/projects/c13f10bd1059418395411296467ae379/users/0aebc272f2854d79bb5de1090bfb3c99/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:12.192663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a66d67-fce7-4e99-8724-437811e7e7df None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.192979 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a66d67-fce7-4e99-8724-437811e7e7df None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.193257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a66d67-fce7-4e99-8724-437811e7e7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.220163 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-61a66d67-fce7-4e99-8724-437811e7e7df None None] MFA Rules not processed for user `0aebc272f2854d79bb5de1090bfb3c99`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:12.221465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-61a66d67-fce7-4e99-8724-437811e7e7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:12.287281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1163/2302] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:12.292360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979e6e5-436b-42bf-919a-9507308e513c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:12.355972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979e6e5-436b-42bf-919a-9507308e513c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.361243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499dba5-6af4-4a0f-9984-809c93acec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.361896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499dba5-6af4-4a0f-9984-809c93acec86 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.362220 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499dba5-6af4-4a0f-9984-809c93acec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.362529 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499dba5-6af4-4a0f-9984-809c93acec86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.363326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499dba5-6af4-4a0f-9984-809c93acec86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:12.365628 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499dba5-6af4-4a0f-9984-809c93acec86 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:12.397108 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1140/2303] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:12 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:12.400938 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a66d67-fce7-4e99-8724-437811e7e7df None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:12.411818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a66d67-fce7-4e99-8724-437811e7e7df None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.479630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebedee0-6b48-449e-8a1a-c98c77f653aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.480341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebedee0-6b48-449e-8a1a-c98c77f653aa admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.480623 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebedee0-6b48-449e-8a1a-c98c77f653aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.480897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebedee0-6b48-449e-8a1a-c98c77f653aa admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.481581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebedee0-6b48-449e-8a1a-c98c77f653aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:12.483523 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebedee0-6b48-449e-8a1a-c98c77f653aa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:12.505614 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1164/2304] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:12 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:12.509758 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499dba5-6af4-4a0f-9984-809c93acec86 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:12.520422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499dba5-6af4-4a0f-9984-809c93acec86 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.525988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d67da-eb01-49fb-96bf-be2877158e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.526645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d67da-eb01-49fb-96bf-be2877158e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.526970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d67da-eb01-49fb-96bf-be2877158e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.527246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d67da-eb01-49fb-96bf-be2877158e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.527963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d67da-eb01-49fb-96bf-be2877158e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:12.529569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d67da-eb01-49fb-96bf-be2877158e88 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:12.542900 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1141/2305] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:12.546220 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebedee0-6b48-449e-8a1a-c98c77f653aa admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:12.557884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebedee0-6b48-449e-8a1a-c98c77f653aa admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.562709 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517ecef-3f02-4dc9-9a85-08cfc3826f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.563367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517ecef-3f02-4dc9-9a85-08cfc3826f41 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.563648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517ecef-3f02-4dc9-9a85-08cfc3826f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.563919 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517ecef-3f02-4dc9-9a85-08cfc3826f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.564667 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517ecef-3f02-4dc9-9a85-08cfc3826f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:12.566276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9517ecef-3f02-4dc9-9a85-08cfc3826f41 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:12.577775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1165/2306] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:12.581731 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d67da-eb01-49fb-96bf-be2877158e88 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:12.592738 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d67da-eb01-49fb-96bf-be2877158e88 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.597712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d0886-378b-4e25-a9c9-8336351c6371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.598583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d0886-378b-4e25-a9c9-8336351c6371 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.598857 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d0886-378b-4e25-a9c9-8336351c6371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.599126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d0886-378b-4e25-a9c9-8336351c6371 admin admin] PATH_INFO: `/v3/projects/c871f99b908349e0a664553ca64578b3/users/19ed8f26f4ac4be9b88f1139e70cbf0e/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.614782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d0886-378b-4e25-a9c9-8336351c6371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c871f99b908349e0a664553ca64578b3, user_id=19ed8f26f4ac4be9b88f1139e70cbf0e, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:12.617624 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d0886-378b-4e25-a9c9-8336351c6371 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:12.630499 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1142/2307] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:12 2022] PUT /identity/v3/projects/c871f99b908349e0a664553ca64578b3/users/19ed8f26f4ac4be9b88f1139e70cbf0e/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:12.641038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3712bc-7ae7-44d7-8117-ea78f4c78eaf None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.641329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3712bc-7ae7-44d7-8117-ea78f4c78eaf None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.641607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3712bc-7ae7-44d7-8117-ea78f4c78eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.667798 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0e3712bc-7ae7-44d7-8117-ea78f4c78eaf None None] MFA Rules not processed for user `19ed8f26f4ac4be9b88f1139e70cbf0e`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:12.669058 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0e3712bc-7ae7-44d7-8117-ea78f4c78eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:12.734099 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1166/2308] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:12.738676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d0886-378b-4e25-a9c9-8336351c6371 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:12.801806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d0886-378b-4e25-a9c9-8336351c6371 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.807225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e656ce-643b-4554-bd21-2596cbfc26e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.807897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e656ce-643b-4554-bd21-2596cbfc26e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.808197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e656ce-643b-4554-bd21-2596cbfc26e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.808469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e656ce-643b-4554-bd21-2596cbfc26e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.809200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e656ce-643b-4554-bd21-2596cbfc26e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:12.811110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e656ce-643b-4554-bd21-2596cbfc26e6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:12.836495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1143/2309] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:12 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:12.840617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3712bc-7ae7-44d7-8117-ea78f4c78eaf None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:12.852725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3712bc-7ae7-44d7-8117-ea78f4c78eaf None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.906393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d3140-c9e0-4de3-ab53-400f81fa248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.907056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d3140-c9e0-4de3-ab53-400f81fa248e admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.907338 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d3140-c9e0-4de3-ab53-400f81fa248e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.907620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d3140-c9e0-4de3-ab53-400f81fa248e admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.908607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d3140-c9e0-4de3-ab53-400f81fa248e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:12.910539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d3140-c9e0-4de3-ab53-400f81fa248e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:12.932082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1167/2310] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:12 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:12.935903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e656ce-643b-4554-bd21-2596cbfc26e6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:12.946996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e656ce-643b-4554-bd21-2596cbfc26e6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.951553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78aad31-e6eb-4d58-898b-7d33d03c03bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.952234 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78aad31-e6eb-4d58-898b-7d33d03c03bb admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.952517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78aad31-e6eb-4d58-898b-7d33d03c03bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.952792 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78aad31-e6eb-4d58-898b-7d33d03c03bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:12.953505 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78aad31-e6eb-4d58-898b-7d33d03c03bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:12.955084 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78aad31-e6eb-4d58-898b-7d33d03c03bb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:12.966140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1144/2311] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:12.970295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d3140-c9e0-4de3-ab53-400f81fa248e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:12.980535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d3140-c9e0-4de3-ab53-400f81fa248e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:12.985287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96aa6b-969a-43f4-be1b-1df1a2a4601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:12.986167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96aa6b-969a-43f4-be1b-1df1a2a4601b admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:12.986448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96aa6b-969a-43f4-be1b-1df1a2a4601b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:12.986733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96aa6b-969a-43f4-be1b-1df1a2a4601b admin admin] PATH_INFO: `/v3/projects/53f3f92ec282499ebf65f6107ca09dad/users/94116218500d4a7fa8f98e0559d5145b/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:13.003921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96aa6b-969a-43f4-be1b-1df1a2a4601b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f3f92ec282499ebf65f6107ca09dad, user_id=94116218500d4a7fa8f98e0559d5145b, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:13.007252 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96aa6b-969a-43f4-be1b-1df1a2a4601b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:13.020910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1168/2312] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:12 2022] PUT /identity/v3/projects/53f3f92ec282499ebf65f6107ca09dad/users/94116218500d4a7fa8f98e0559d5145b/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:13.025579 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78aad31-e6eb-4d58-898b-7d33d03c03bb admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:13.037287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78aad31-e6eb-4d58-898b-7d33d03c03bb admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:13.107308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639c2c4-3c29-4628-8498-aa1e695bc6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:13.107975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639c2c4-3c29-4628-8498-aa1e695bc6bb admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:13.108279 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639c2c4-3c29-4628-8498-aa1e695bc6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:13.108555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639c2c4-3c29-4628-8498-aa1e695bc6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:13.109270 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639c2c4-3c29-4628-8498-aa1e695bc6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:13.110857 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639c2c4-3c29-4628-8498-aa1e695bc6bb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:13.122069 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1145/2313] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:13.126230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96aa6b-969a-43f4-be1b-1df1a2a4601b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:13.136851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96aa6b-969a-43f4-be1b-1df1a2a4601b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:13.141546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baeb28-d0d5-43d6-b03e-36624026a857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:13.142421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baeb28-d0d5-43d6-b03e-36624026a857 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:13.142712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baeb28-d0d5-43d6-b03e-36624026a857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:13.142988 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baeb28-d0d5-43d6-b03e-36624026a857 admin admin] PATH_INFO: `/v3/projects/53f3f92ec282499ebf65f6107ca09dad/users/94116218500d4a7fa8f98e0559d5145b/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:13.144994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baeb28-d0d5-43d6-b03e-36624026a857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f3f92ec282499ebf65f6107ca09dad, user_id=94116218500d4a7fa8f98e0559d5145b, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:13.148281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21baeb28-d0d5-43d6-b03e-36624026a857 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:13.158701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1169/2314] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:13 2022] PUT /identity/v3/projects/53f3f92ec282499ebf65f6107ca09dad/users/94116218500d4a7fa8f98e0559d5145b/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:13.169681 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2217-87ac-446c-93d2-70cb4de3f2bc None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:13.170184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2217-87ac-446c-93d2-70cb4de3f2bc None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:13.170281 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2217-87ac-446c-93d2-70cb4de3f2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:13.195877 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-cc7f2217-87ac-446c-93d2-70cb4de3f2bc None None] MFA Rules not processed for user `94116218500d4a7fa8f98e0559d5145b`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:13.197109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-cc7f2217-87ac-446c-93d2-70cb4de3f2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:13.262345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1146/2315] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:13.272745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baeb28-d0d5-43d6-b03e-36624026a857 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:13.274514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-21baeb28-d0d5-43d6-b03e-36624026a857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:13.355632 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baeb28-d0d5-43d6-b03e-36624026a857 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:13.359322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbfecc-e7d9-4627-8cf4-bd4474703ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:13.359892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbfecc-e7d9-4627-8cf4-bd4474703ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:13.360202 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbfecc-e7d9-4627-8cf4-bd4474703ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:13.360486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbfecc-e7d9-4627-8cf4-bd4474703ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:13.369214 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbfecc-e7d9-4627-8cf4-bd4474703ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:13.370636 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbfecc-e7d9-4627-8cf4-bd4474703ed7 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:13.379608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1170/2316] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:13.424705 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2217-87ac-446c-93d2-70cb4de3f2bc None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:13.426112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-cc7f2217-87ac-446c-93d2-70cb4de3f2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:13.438596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2217-87ac-446c-93d2-70cb4de3f2bc None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:13.442937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704122c-565a-4707-90a1-32f626cc11fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:13.443744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704122c-565a-4707-90a1-32f626cc11fe service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:13.444812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704122c-565a-4707-90a1-32f626cc11fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:13.445203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704122c-565a-4707-90a1-32f626cc11fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:13.501771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704122c-565a-4707-90a1-32f626cc11fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:13.503221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704122c-565a-4707-90a1-32f626cc11fe service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:13.512186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1147/2317] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:13.846706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbfecc-e7d9-4627-8cf4-bd4474703ed7 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:13.912325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbfecc-e7d9-4627-8cf4-bd4474703ed7 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:13.917319 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:13.918187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:13.918540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:13.918856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] PATH_INFO: `/v3/users/0aebc272f2854d79bb5de1090bfb3c99` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:13.920316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aebc272f2854d79bb5de1090bfb3c99)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:13.922640 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:13.966345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aebc272f2854d79bb5de1090bfb3c99'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:13.978105 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aebc272f2854d79bb5de1090bfb3c99'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:13.978818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aebc272f2854d79bb5de1090bfb3c99'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:13.985104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aebc272f2854d79bb5de1090bfb3c99'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:13.992472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aebc272f2854d79bb5de1090bfb3c99'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:13.998098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1171/2318] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:13 2022] DELETE /identity/v3/users/0aebc272f2854d79bb5de1090bfb3c99 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:14.002653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a68b7a-3edf-4a25-9bc8-702ca1fdf316 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:14.002944 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a68b7a-3edf-4a25-9bc8-702ca1fdf316 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:14.003218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a68b7a-3edf-4a25-9bc8-702ca1fdf316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:14.021394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-07a68b7a-3edf-4a25-9bc8-702ca1fdf316 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:14.022587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-07a68b7a-3edf-4a25-9bc8-702ca1fdf316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:14.079276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1148/2319] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:14.089154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:14.090553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:14.145927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a72d02-f5d4-4c46-bb06-40b3e5985dd2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:14.149464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8de2f-e4c3-49f9-845c-83b16bcca90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:14.150107 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8de2f-e4c3-49f9-845c-83b16bcca90b service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:14.150373 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8de2f-e4c3-49f9-845c-83b16bcca90b service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:14.150644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8de2f-e4c3-49f9-845c-83b16bcca90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:14.159587 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8de2f-e4c3-49f9-845c-83b16bcca90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:14.161009 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8de2f-e4c3-49f9-845c-83b16bcca90b service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:14.170589 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1172/2320] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:14.424736 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a68b7a-3edf-4a25-9bc8-702ca1fdf316 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:14.426342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-07a68b7a-3edf-4a25-9bc8-702ca1fdf316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:14.439274 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a68b7a-3edf-4a25-9bc8-702ca1fdf316 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:14.445146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:14.446096 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:14.446443 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:14.446789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] PATH_INFO: `/v3/projects/c13f10bd1059418395411296467ae379` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:14.448113 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13f10bd1059418395411296467ae379)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:14.450145 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:14.497419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13f10bd1059418395411296467ae379', 'request_id': 'req-91644cf5-d3f1-47ce-8ffd-6481926cf664'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:14.502596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13f10bd1059418395411296467ae379', 'request_id': 'req-91644cf5-d3f1-47ce-8ffd-6481926cf664'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:14.508879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13f10bd1059418395411296467ae379', 'request_id': 'req-91644cf5-d3f1-47ce-8ffd-6481926cf664'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:14.520976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] The token cache is being invalidate because project c13f10bd1059418395411296467ae379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:14.521250 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:14.521877 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:14.524074 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1149/2321] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:14 2022] DELETE /identity/v3/projects/c13f10bd1059418395411296467ae379 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:14.527972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8de2f-e4c3-49f9-845c-83b16bcca90b service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:14.538818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8de2f-e4c3-49f9-845c-83b16bcca90b service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:14.592560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:14.593440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:14.593740 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:14.594011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] PATH_INFO: `/v3/users/19ed8f26f4ac4be9b88f1139e70cbf0e` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:14.595189 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ed8f26f4ac4be9b88f1139e70cbf0e)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:14.597134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:14.640960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ed8f26f4ac4be9b88f1139e70cbf0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:14.652938 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ed8f26f4ac4be9b88f1139e70cbf0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:14.653625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ed8f26f4ac4be9b88f1139e70cbf0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:14.660655 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ed8f26f4ac4be9b88f1139e70cbf0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:14.668214 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ed8f26f4ac4be9b88f1139e70cbf0e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:14.673911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1173/2322] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:14 2022] DELETE /identity/v3/users/19ed8f26f4ac4be9b88f1139e70cbf0e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:14.974172 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:14.975766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:14.989326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91644cf5-d3f1-47ce-8ffd-6481926cf664 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:15.054658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:15.055742 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:15.056045 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:15.056324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] PATH_INFO: `/v3/projects/c871f99b908349e0a664553ca64578b3` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:15.057556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=c871f99b908349e0a664553ca64578b3)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:15.059470 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:15.105525 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c871f99b908349e0a664553ca64578b3', 'request_id': 'req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.110670 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c871f99b908349e0a664553ca64578b3', 'request_id': 'req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.116949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c871f99b908349e0a664553ca64578b3', 'request_id': 'req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.129133 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] The token cache is being invalidate because project c871f99b908349e0a664553ca64578b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:15.129420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.130041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.132840 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1150/2323] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:14 2022] DELETE /identity/v3/projects/c871f99b908349e0a664553ca64578b3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:15.137093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:15.138826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:15.152432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06417d2-ab6f-4151-8360-0122c77087b7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:15.208233 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c829591-4f96-4836-9b9f-b020ccebd0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:15.209027 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829591-4f96-4836-9b9f-b020ccebd0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:15.209307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829591-4f96-4836-9b9f-b020ccebd0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:15.209583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c829591-4f96-4836-9b9f-b020ccebd0d1 admin admin] PATH_INFO: `/v3/users/94116218500d4a7fa8f98e0559d5145b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:15.211543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c829591-4f96-4836-9b9f-b020ccebd0d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94116218500d4a7fa8f98e0559d5145b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:15.213490 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c829591-4f96-4836-9b9f-b020ccebd0d1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:15.260542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-7c829591-4f96-4836-9b9f-b020ccebd0d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94116218500d4a7fa8f98e0559d5145b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.274683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-7c829591-4f96-4836-9b9f-b020ccebd0d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94116218500d4a7fa8f98e0559d5145b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.275413 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-7c829591-4f96-4836-9b9f-b020ccebd0d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94116218500d4a7fa8f98e0559d5145b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.284369 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-7c829591-4f96-4836-9b9f-b020ccebd0d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94116218500d4a7fa8f98e0559d5145b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.291751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-7c829591-4f96-4836-9b9f-b020ccebd0d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94116218500d4a7fa8f98e0559d5145b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.297802 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1174/2324] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:15 2022] DELETE /identity/v3/users/94116218500d4a7fa8f98e0559d5145b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:15.568049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:15.570295 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:15.583336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae83e2-d9e9-4f39-9f2e-10c04661b0ad admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:15.650451 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253caa5-1c30-4792-af5f-59378e0c67f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:15.651319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253caa5-1c30-4792-af5f-59378e0c67f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:15.651601 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253caa5-1c30-4792-af5f-59378e0c67f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:15.651881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253caa5-1c30-4792-af5f-59378e0c67f3 admin admin] PATH_INFO: `/v3/projects/53f3f92ec282499ebf65f6107ca09dad` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:15.653111 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253caa5-1c30-4792-af5f-59378e0c67f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f3f92ec282499ebf65f6107ca09dad)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:15.655059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253caa5-1c30-4792-af5f-59378e0c67f3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:15.702518 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e253caa5-1c30-4792-af5f-59378e0c67f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f3f92ec282499ebf65f6107ca09dad', 'request_id': 'req-e253caa5-1c30-4792-af5f-59378e0c67f3'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.707722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e253caa5-1c30-4792-af5f-59378e0c67f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f3f92ec282499ebf65f6107ca09dad', 'request_id': 'req-e253caa5-1c30-4792-af5f-59378e0c67f3'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.713969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e253caa5-1c30-4792-af5f-59378e0c67f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f3f92ec282499ebf65f6107ca09dad', 'request_id': 'req-e253caa5-1c30-4792-af5f-59378e0c67f3'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.727014 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e253caa5-1c30-4792-af5f-59378e0c67f3 admin admin] The token cache is being invalidate because project 53f3f92ec282499ebf65f6107ca09dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:15.727298 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e253caa5-1c30-4792-af5f-59378e0c67f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.727920 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e253caa5-1c30-4792-af5f-59378e0c67f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:15.730298 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1151/2325] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:15 2022] DELETE /identity/v3/projects/53f3f92ec282499ebf65f6107ca09dad => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:15.735997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf1b69-84d8-4e9e-9e80-cec598df09ae None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:15.736394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf1b69-84d8-4e9e-9e80-cec598df09ae None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:15.736680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf1b69-84d8-4e9e-9e80-cec598df09ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:15.756429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-57cf1b69-84d8-4e9e-9e80-cec598df09ae None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:15.758100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-57cf1b69-84d8-4e9e-9e80-cec598df09ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:15.817166 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1175/2326] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:15.827174 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa62a8-bdb8-4ace-bac1-eb2ffafd4b24 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:15.827691 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa62a8-bdb8-4ace-bac1-eb2ffafd4b24 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:15.827880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa62a8-bdb8-4ace-bac1-eb2ffafd4b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:15.846195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-baaa62a8-bdb8-4ace-bac1-eb2ffafd4b24 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:15.847389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-baaa62a8-bdb8-4ace-bac1-eb2ffafd4b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:15.856301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1152/2327] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:15.860935 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf1b69-84d8-4e9e-9e80-cec598df09ae None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:15.871022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf1b69-84d8-4e9e-9e80-cec598df09ae None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:15.875568 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445feab-1331-4625-8dd3-f00cbc65f504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:15.876259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445feab-1331-4625-8dd3-f00cbc65f504 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:15.876543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445feab-1331-4625-8dd3-f00cbc65f504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:15.876833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445feab-1331-4625-8dd3-f00cbc65f504 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:15.877553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445feab-1331-4625-8dd3-f00cbc65f504 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:32:15.877860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445feab-1331-4625-8dd3-f00cbc65f504 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:15.879441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445feab-1331-4625-8dd3-f00cbc65f504 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:15.890893 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1176/2328] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:32:15.895332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa62a8-bdb8-4ace-bac1-eb2ffafd4b24 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:15.906430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa62a8-bdb8-4ace-bac1-eb2ffafd4b24 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:15.911414 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8723a-34d2-4a1f-8828-6c428052b8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:15.912135 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8723a-34d2-4a1f-8828-6c428052b8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:15.912416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8723a-34d2-4a1f-8828-6c428052b8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:15.912687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8723a-34d2-4a1f-8828-6c428052b8f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:15.914160 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8723a-34d2-4a1f-8828-6c428052b8f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:15.916099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8723a-34d2-4a1f-8828-6c428052b8f9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:15.942037 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1153/2329] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:15 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:15.945640 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445feab-1331-4625-8dd3-f00cbc65f504 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:15.955351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445feab-1331-4625-8dd3-f00cbc65f504 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:16.009921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0c93a-631f-4d48-9312-0bb71ef35a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:16.010522 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0c93a-631f-4d48-9312-0bb71ef35a7d admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.010801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0c93a-631f-4d48-9312-0bb71ef35a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.011072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0c93a-631f-4d48-9312-0bb71ef35a7d admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.011782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0c93a-631f-4d48-9312-0bb71ef35a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:16.013719 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0c93a-631f-4d48-9312-0bb71ef35a7d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:16.034420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1177/2330] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:15 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:16.040837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8723a-34d2-4a1f-8828-6c428052b8f9 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:16.051102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8723a-34d2-4a1f-8828-6c428052b8f9 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:16.056245 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e30cb5-3463-49f0-a967-01cf83e59fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:16.056934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e30cb5-3463-49f0-a967-01cf83e59fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.057218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e30cb5-3463-49f0-a967-01cf83e59fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.057497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e30cb5-3463-49f0-a967-01cf83e59fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.058219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e30cb5-3463-49f0-a967-01cf83e59fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:16.059844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e30cb5-3463-49f0-a967-01cf83e59fa3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:16.073194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1154/2331] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:16.074341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0c93a-631f-4d48-9312-0bb71ef35a7d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:16.084525 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0c93a-631f-4d48-9312-0bb71ef35a7d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:16.089992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220f43b-12c6-4635-bea0-d6f780edda87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:16.090722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220f43b-12c6-4635-bea0-d6f780edda87 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.091078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220f43b-12c6-4635-bea0-d6f780edda87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.091424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220f43b-12c6-4635-bea0-d6f780edda87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.092250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220f43b-12c6-4635-bea0-d6f780edda87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:16.093931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220f43b-12c6-4635-bea0-d6f780edda87 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:16.104942 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1178/2332] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:16.108830 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e30cb5-3463-49f0-a967-01cf83e59fa3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:16.114761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220f43b-12c6-4635-bea0-d6f780edda87 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:16.116893 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9220f43b-12c6-4635-bea0-d6f780edda87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:16.119095 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e30cb5-3463-49f0-a967-01cf83e59fa3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:16.124367 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa10be-3cfb-4ac5-a609-08ef3072001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:16.125333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa10be-3cfb-4ac5-a609-08ef3072001a admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.125719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa10be-3cfb-4ac5-a609-08ef3072001a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.126065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa10be-3cfb-4ac5-a609-08ef3072001a admin admin] PATH_INFO: `/v3/projects/9e63f6b6e9334ad3a8651e71084ee9d9/users/cf20f0cbdfb14eabb2a330c7156abcce/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.142942 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa10be-3cfb-4ac5-a609-08ef3072001a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e63f6b6e9334ad3a8651e71084ee9d9, user_id=cf20f0cbdfb14eabb2a330c7156abcce, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:16.145671 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa10be-3cfb-4ac5-a609-08ef3072001a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:16.160205 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1155/2333] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:16 2022] PUT /identity/v3/projects/9e63f6b6e9334ad3a8651e71084ee9d9/users/cf20f0cbdfb14eabb2a330c7156abcce/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:16.172075 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddde48-510d-429f-b97f-73a50593a23b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.172369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddde48-510d-429f-b97f-73a50593a23b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.172645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ddde48-510d-429f-b97f-73a50593a23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.180626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220f43b-12c6-4635-bea0-d6f780edda87 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:16.198130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-81ddde48-510d-429f-b97f-73a50593a23b None None] MFA Rules not processed for user `cf20f0cbdfb14eabb2a330c7156abcce`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:16.199329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-81ddde48-510d-429f-b97f-73a50593a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:16.250789 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6e194-62d5-481f-ab0c-0a1de08370ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:16.251437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6e194-62d5-481f-ab0c-0a1de08370ad service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.251718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6e194-62d5-481f-ab0c-0a1de08370ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.251994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6e194-62d5-481f-ab0c-0a1de08370ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.253817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9cb6e194-62d5-481f-ab0c-0a1de08370ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:16.265303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1156/2334] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:16.269604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddde48-510d-429f-b97f-73a50593a23b None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:16.323436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6e194-62d5-481f-ab0c-0a1de08370ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:16.324934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6e194-62d5-481f-ab0c-0a1de08370ad service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:16.331427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ddde48-510d-429f-b97f-73a50593a23b None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:16.336549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1179/2335] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:16.337352 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d29da2-4bf7-43c0-b28b-35ba8f270684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:16.338077 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d29da2-4bf7-43c0-b28b-35ba8f270684 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.338364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d29da2-4bf7-43c0-b28b-35ba8f270684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.338768 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d29da2-4bf7-43c0-b28b-35ba8f270684 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.339466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d29da2-4bf7-43c0-b28b-35ba8f270684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:16.341463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d29da2-4bf7-43c0-b28b-35ba8f270684 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:16.370047 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1157/2336] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:16 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:16.374742 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6e194-62d5-481f-ab0c-0a1de08370ad service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:16.387955 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6e194-62d5-481f-ab0c-0a1de08370ad service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:16.447316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba371cda-d3d5-42aa-8d63-91afb564c159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:16.447912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba371cda-d3d5-42aa-8d63-91afb564c159 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.448228 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba371cda-d3d5-42aa-8d63-91afb564c159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.448509 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba371cda-d3d5-42aa-8d63-91afb564c159 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.449213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba371cda-d3d5-42aa-8d63-91afb564c159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:16.451154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba371cda-d3d5-42aa-8d63-91afb564c159 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:16.471733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1180/2337] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:16 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:16.476352 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d29da2-4bf7-43c0-b28b-35ba8f270684 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:16.487361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d29da2-4bf7-43c0-b28b-35ba8f270684 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:16.492985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc0375-cdff-4741-9955-547fee516b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:16.493631 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc0375-cdff-4741-9955-547fee516b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.493919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc0375-cdff-4741-9955-547fee516b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.494212 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc0375-cdff-4741-9955-547fee516b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.494909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc0375-cdff-4741-9955-547fee516b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:16.496544 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc0375-cdff-4741-9955-547fee516b44 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:16.506714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1158/2338] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:16.511070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba371cda-d3d5-42aa-8d63-91afb564c159 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:16.521471 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba371cda-d3d5-42aa-8d63-91afb564c159 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:16.526225 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6ef73-007d-41ee-8474-53288eaccd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:16.527104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6ef73-007d-41ee-8474-53288eaccd9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.527389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6ef73-007d-41ee-8474-53288eaccd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.527667 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6ef73-007d-41ee-8474-53288eaccd9c admin admin] PATH_INFO: `/v3/projects/4695ddebbe9e465dade0d517c0e3da53/users/33f4565cc53f4c1eb8482329959a9910/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.544609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6ef73-007d-41ee-8474-53288eaccd9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4695ddebbe9e465dade0d517c0e3da53, user_id=33f4565cc53f4c1eb8482329959a9910, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:16.547261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6ef73-007d-41ee-8474-53288eaccd9c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:16.561148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1181/2339] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:16 2022] PUT /identity/v3/projects/4695ddebbe9e465dade0d517c0e3da53/users/33f4565cc53f4c1eb8482329959a9910/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:16.565265 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc0375-cdff-4741-9955-547fee516b44 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:16.575500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc0375-cdff-4741-9955-547fee516b44 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:16.628239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706df7e7-b1ea-417e-b771-d455844fa533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:16.628893 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706df7e7-b1ea-417e-b771-d455844fa533 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.629172 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706df7e7-b1ea-417e-b771-d455844fa533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.629445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706df7e7-b1ea-417e-b771-d455844fa533 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.630148 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706df7e7-b1ea-417e-b771-d455844fa533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:16.631721 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706df7e7-b1ea-417e-b771-d455844fa533 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:16.641197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1159/2340] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:32:16.645493 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6ef73-007d-41ee-8474-53288eaccd9c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:16.656003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6ef73-007d-41ee-8474-53288eaccd9c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:16.661140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4cdf0-cbfb-4485-8c9a-1d9a9840c227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:16.662012 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4cdf0-cbfb-4485-8c9a-1d9a9840c227 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.662300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4cdf0-cbfb-4485-8c9a-1d9a9840c227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.662579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4cdf0-cbfb-4485-8c9a-1d9a9840c227 admin admin] PATH_INFO: `/v3/projects/4695ddebbe9e465dade0d517c0e3da53/users/33f4565cc53f4c1eb8482329959a9910/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.665396 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4cdf0-cbfb-4485-8c9a-1d9a9840c227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4695ddebbe9e465dade0d517c0e3da53, user_id=33f4565cc53f4c1eb8482329959a9910, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:16.668175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4cdf0-cbfb-4485-8c9a-1d9a9840c227 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:16.679725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1182/2341] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:16 2022] PUT /identity/v3/projects/4695ddebbe9e465dade0d517c0e3da53/users/33f4565cc53f4c1eb8482329959a9910/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:16.689885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8ccd-36d9-4d0e-a085-98980e1f6104 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.690171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8ccd-36d9-4d0e-a085-98980e1f6104 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.690447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d8ccd-36d9-4d0e-a085-98980e1f6104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.717889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-008d8ccd-36d9-4d0e-a085-98980e1f6104 None None] MFA Rules not processed for user `33f4565cc53f4c1eb8482329959a9910`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:16.719099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-008d8ccd-36d9-4d0e-a085-98980e1f6104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:16.784728 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1160/2342] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:16.794897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4cdf0-cbfb-4485-8c9a-1d9a9840c227 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:16.796646 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fde4cdf0-cbfb-4485-8c9a-1d9a9840c227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:16.853057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4cdf0-cbfb-4485-8c9a-1d9a9840c227 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:16.856792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a87e1-5094-4fda-bb8b-fd12f67be404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:16.857424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a87e1-5094-4fda-bb8b-fd12f67be404 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:16.857707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a87e1-5094-4fda-bb8b-fd12f67be404 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:16.857988 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a87e1-5094-4fda-bb8b-fd12f67be404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:16.912888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a87e1-5094-4fda-bb8b-fd12f67be404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:16.915282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a87e1-5094-4fda-bb8b-fd12f67be404 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:16.925001 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1183/2343] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:17.516795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8ccd-36d9-4d0e-a085-98980e1f6104 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:17.571351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d8ccd-36d9-4d0e-a085-98980e1f6104 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:17.575065 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ae437-2701-428a-a82e-bfcc2c82ddcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:17.575695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ae437-2701-428a-a82e-bfcc2c82ddcf service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:17.576272 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ae437-2701-428a-a82e-bfcc2c82ddcf service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:17.576272 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ae437-2701-428a-a82e-bfcc2c82ddcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:17.578011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-fa3ae437-2701-428a-a82e-bfcc2c82ddcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:17.651316 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ae437-2701-428a-a82e-bfcc2c82ddcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:17.652777 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ae437-2701-428a-a82e-bfcc2c82ddcf service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:17.664360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1161/2344] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:21.028736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a87e1-5094-4fda-bb8b-fd12f67be404 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:21.030126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-be1a87e1-5094-4fda-bb8b-fd12f67be404 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:21.042380 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a87e1-5094-4fda-bb8b-fd12f67be404 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:21.045974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e58aa-4292-48db-aca5-3733d2b6d43c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:21.046606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e58aa-4292-48db-aca5-3733d2b6d43c service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:21.046889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e58aa-4292-48db-aca5-3733d2b6d43c service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:21.047162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e58aa-4292-48db-aca5-3733d2b6d43c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:21.056574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e58aa-4292-48db-aca5-3733d2b6d43c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:21.057989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e58aa-4292-48db-aca5-3733d2b6d43c service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:21.067207 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1184/2345] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:22.574144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ae437-2701-428a-a82e-bfcc2c82ddcf service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:22.583469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ae437-2701-428a-a82e-bfcc2c82ddcf service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:22.589024 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fb321-34d7-40c3-b249-671db5df370e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:22.589787 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fb321-34d7-40c3-b249-671db5df370e service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:22.590034 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fb321-34d7-40c3-b249-671db5df370e service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:22.590392 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fb321-34d7-40c3-b249-671db5df370e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:22.592362 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0c4fb321-34d7-40c3-b249-671db5df370e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:22.656799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fb321-34d7-40c3-b249-671db5df370e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:22.658226 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fb321-34d7-40c3-b249-671db5df370e service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:22.668743 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1162/2346] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:25.928057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e58aa-4292-48db-aca5-3733d2b6d43c service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:25.942037 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e58aa-4292-48db-aca5-3733d2b6d43c service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:25.948752 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:25.951558 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:25.952308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:25.952827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] PATH_INFO: `/v3/users/cf20f0cbdfb14eabb2a330c7156abcce` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:25.954488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf20f0cbdfb14eabb2a330c7156abcce)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:25.956818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:26.027156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf20f0cbdfb14eabb2a330c7156abcce'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.048048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf20f0cbdfb14eabb2a330c7156abcce'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.048970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf20f0cbdfb14eabb2a330c7156abcce'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.061241 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf20f0cbdfb14eabb2a330c7156abcce'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.069924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf20f0cbdfb14eabb2a330c7156abcce'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.077319 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1185/2347] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:25 2022] DELETE /identity/v3/users/cf20f0cbdfb14eabb2a330c7156abcce => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:26.081883 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d607e1-76c8-4420-a268-c98a5e4f897f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:26.082363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d607e1-76c8-4420-a268-c98a5e4f897f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:26.082457 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d607e1-76c8-4420-a268-c98a5e4f897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:26.102770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-90d607e1-76c8-4420-a268-c98a5e4f897f None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:26.104151 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-90d607e1-76c8-4420-a268-c98a5e4f897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:26.172382 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1163/2348] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:26.184847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:26.184847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:26.186343 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d607e1-76c8-4420-a268-c98a5e4f897f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:26.187964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-90d607e1-76c8-4420-a268-c98a5e4f897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:26.201483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d607e1-76c8-4420-a268-c98a5e4f897f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:26.206228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:26.207136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:26.207418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:26.207687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] PATH_INFO: `/v3/users/ff9ca3b6201b4f5780ccb309dc0440c7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:26.208927 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9ca3b6201b4f5780ccb309dc0440c7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:26.212108 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:26.249944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d0ed-c188-4aa3-bef0-385630d3642f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:26.253969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb719ecb-c84c-4a9e-a2d4-3afcab21a494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:26.254621 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb719ecb-c84c-4a9e-a2d4-3afcab21a494 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:26.254902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb719ecb-c84c-4a9e-a2d4-3afcab21a494 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:26.255177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb719ecb-c84c-4a9e-a2d4-3afcab21a494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:26.260051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9ca3b6201b4f5780ccb309dc0440c7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.265148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb719ecb-c84c-4a9e-a2d4-3afcab21a494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:26.266618 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb719ecb-c84c-4a9e-a2d4-3afcab21a494 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:26.276072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9ca3b6201b4f5780ccb309dc0440c7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.277379 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1186/2349] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:32:26.287583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9ca3b6201b4f5780ccb309dc0440c7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.295403 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9ca3b6201b4f5780ccb309dc0440c7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.296154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9ca3b6201b4f5780ccb309dc0440c7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.302186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1164/2350] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:26 2022] DELETE /identity/v3/users/ff9ca3b6201b4f5780ccb309dc0440c7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:26.477902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb719ecb-c84c-4a9e-a2d4-3afcab21a494 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:26.489129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb719ecb-c84c-4a9e-a2d4-3afcab21a494 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:26.566005 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb6242-9ce0-4748-89ff-3af8b4f64707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:26.566858 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb6242-9ce0-4748-89ff-3af8b4f64707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:26.567125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb6242-9ce0-4748-89ff-3af8b4f64707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:26.567401 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb6242-9ce0-4748-89ff-3af8b4f64707 admin admin] PATH_INFO: `/v3/projects/7e491ed94c27421d8033572221092bbd` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:26.568598 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb6242-9ce0-4748-89ff-3af8b4f64707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e491ed94c27421d8033572221092bbd)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:26.571201 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb6242-9ce0-4748-89ff-3af8b4f64707 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:26.615727 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5afb6242-9ce0-4748-89ff-3af8b4f64707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e491ed94c27421d8033572221092bbd', 'request_id': 'req-5afb6242-9ce0-4748-89ff-3af8b4f64707'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.622171 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5afb6242-9ce0-4748-89ff-3af8b4f64707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e491ed94c27421d8033572221092bbd', 'request_id': 'req-5afb6242-9ce0-4748-89ff-3af8b4f64707'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.628529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5afb6242-9ce0-4748-89ff-3af8b4f64707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e491ed94c27421d8033572221092bbd', 'request_id': 'req-5afb6242-9ce0-4748-89ff-3af8b4f64707'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.644391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5afb6242-9ce0-4748-89ff-3af8b4f64707 admin admin] The token cache is being invalidate because project 7e491ed94c27421d8033572221092bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:26.644391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5afb6242-9ce0-4748-89ff-3af8b4f64707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.644391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5afb6242-9ce0-4748-89ff-3af8b4f64707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.645966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:26.647819 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:26.648420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1187/2351] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:26 2022] DELETE /identity/v3/projects/7e491ed94c27421d8033572221092bbd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:26.650248 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8ba64-db54-47e1-9699-c6f16f4ff273 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:26.650603 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8ba64-db54-47e1-9699-c6f16f4ff273 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:26.651042 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8ba64-db54-47e1-9699-c6f16f4ff273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:26.662725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed3d22-4d7c-4900-9559-a02af555f8fe admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:26.670985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e9d8ba64-db54-47e1-9699-c6f16f4ff273 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:26.672177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e9d8ba64-db54-47e1-9699-c6f16f4ff273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:26.719500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:26.720386 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:26.720668 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:26.720937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] PATH_INFO: `/v3/projects/9e63f6b6e9334ad3a8651e71084ee9d9` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:26.722113 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e63f6b6e9334ad3a8651e71084ee9d9)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:26.724063 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:26.730540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1188/2352] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:26.738316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9b583-0c9f-4e9a-b6da-8e594cc28486 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:26.738609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9b583-0c9f-4e9a-b6da-8e594cc28486 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:26.738887 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9b583-0c9f-4e9a-b6da-8e594cc28486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:26.757463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a0a9b583-0c9f-4e9a-b6da-8e594cc28486 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:26.758693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a0a9b583-0c9f-4e9a-b6da-8e594cc28486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:26.770896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e63f6b6e9334ad3a8651e71084ee9d9', 'request_id': 'req-77d16d33-0d4d-4427-8b7c-04056147ec62'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.776887 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e63f6b6e9334ad3a8651e71084ee9d9', 'request_id': 'req-77d16d33-0d4d-4427-8b7c-04056147ec62'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.782871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e63f6b6e9334ad3a8651e71084ee9d9', 'request_id': 'req-77d16d33-0d4d-4427-8b7c-04056147ec62'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.795825 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] The token cache is being invalidate because project 9e63f6b6e9334ad3a8651e71084ee9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:26.796141 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.796823 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.798373 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1165/2353] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:26 2022] DELETE /identity/v3/projects/9e63f6b6e9334ad3a8651e71084ee9d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:26.802256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:26.803655 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:26.818875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1189/2354] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:26.823459 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9b583-0c9f-4e9a-b6da-8e594cc28486 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:26.832114 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9b583-0c9f-4e9a-b6da-8e594cc28486 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:26.837757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83934ae1-5e85-4578-b133-35861a2ca667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:26.838392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83934ae1-5e85-4578-b133-35861a2ca667 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:26.838672 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83934ae1-5e85-4578-b133-35861a2ca667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:26.838943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83934ae1-5e85-4578-b133-35861a2ca667 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:26.839650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83934ae1-5e85-4578-b133-35861a2ca667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:32:26.839955 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83934ae1-5e85-4578-b133-35861a2ca667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:26.841644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83934ae1-5e85-4578-b133-35861a2ca667 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:26.853447 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1190/2355] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:32:26.857663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83934ae1-5e85-4578-b133-35861a2ca667 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:26.867729 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83934ae1-5e85-4578-b133-35861a2ca667 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:26.869184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d16d33-0d4d-4427-8b7c-04056147ec62 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:26.872578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148b153-666e-47a9-94ee-ce81ebf7d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:26.873240 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148b153-666e-47a9-94ee-ce81ebf7d7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:26.873525 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148b153-666e-47a9-94ee-ce81ebf7d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:26.873797 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148b153-666e-47a9-94ee-ce81ebf7d7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:26.874096 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:26.874474 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148b153-666e-47a9-94ee-ce81ebf7d7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:26.874950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:26.875228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:26.875504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] PATH_INFO: `/v3/users/33f4565cc53f4c1eb8482329959a9910` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:26.876458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148b153-666e-47a9-94ee-ce81ebf7d7c3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:26.876704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f4565cc53f4c1eb8482329959a9910)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:26.878695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:26.903828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1191/2356] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:26 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:26.908383 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148b153-666e-47a9-94ee-ce81ebf7d7c3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:26.926714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f4565cc53f4c1eb8482329959a9910'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.939130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f4565cc53f4c1eb8482329959a9910'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.947548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f4565cc53f4c1eb8482329959a9910'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.954580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f4565cc53f4c1eb8482329959a9910'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.955255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f4565cc53f4c1eb8482329959a9910'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:26.962184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1166/2357] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:26 2022] DELETE /identity/v3/users/33f4565cc53f4c1eb8482329959a9910 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:32:26.973279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148b153-666e-47a9-94ee-ce81ebf7d7c3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:27.033142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a072d-4aa2-4c47-a631-490ebb7b8726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:27.034261 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a072d-4aa2-4c47-a631-490ebb7b8726 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.034577 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a072d-4aa2-4c47-a631-490ebb7b8726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.035078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a072d-4aa2-4c47-a631-490ebb7b8726 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.035804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a072d-4aa2-4c47-a631-490ebb7b8726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:27.038627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a072d-4aa2-4c47-a631-490ebb7b8726 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:27.062746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1192/2358] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:26 2022] POST /identity/v3/users => generated 303 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:27.064489 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:27.066163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:27.080416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c096b-7d57-4426-9633-244cd064a40d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:27.087295 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808c1fc-b7e0-47d4-818b-dcca44e9a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:27.087982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808c1fc-b7e0-47d4-818b-dcca44e9a352 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.088931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808c1fc-b7e0-47d4-818b-dcca44e9a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.088931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808c1fc-b7e0-47d4-818b-dcca44e9a352 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.089387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808c1fc-b7e0-47d4-818b-dcca44e9a352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:27.091002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808c1fc-b7e0-47d4-818b-dcca44e9a352 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:27.106925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1167/2359] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:27.108642 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a072d-4aa2-4c47-a631-490ebb7b8726 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:27.120413 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a072d-4aa2-4c47-a631-490ebb7b8726 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:27.125304 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f1293-26cd-4775-839c-89df5948bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:27.125973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f1293-26cd-4775-839c-89df5948bd16 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.126256 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f1293-26cd-4775-839c-89df5948bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.126531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f1293-26cd-4775-839c-89df5948bd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.127260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f1293-26cd-4775-839c-89df5948bd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:27.129040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f1293-26cd-4775-839c-89df5948bd16 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:27.140372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1193/2360] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:27.144157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808c1fc-b7e0-47d4-818b-dcca44e9a352 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:27.154477 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808c1fc-b7e0-47d4-818b-dcca44e9a352 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:27.159285 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829c373-f05e-40a0-a48a-39f5c9a594b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:27.160212 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829c373-f05e-40a0-a48a-39f5c9a594b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.160489 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829c373-f05e-40a0-a48a-39f5c9a594b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.160765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829c373-f05e-40a0-a48a-39f5c9a594b0 admin admin] PATH_INFO: `/v3/projects/b2d578f0dcd149abbd283b0722d54bc4/users/141fd927383e4ac49831bfe9ff92df56/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.179183 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829c373-f05e-40a0-a48a-39f5c9a594b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d578f0dcd149abbd283b0722d54bc4, user_id=141fd927383e4ac49831bfe9ff92df56, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:27.182606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829c373-f05e-40a0-a48a-39f5c9a594b0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:27.196458 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1168/2361] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:27 2022] PUT /identity/v3/projects/b2d578f0dcd149abbd283b0722d54bc4/users/141fd927383e4ac49831bfe9ff92df56/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:27.201612 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375048-ecd0-45d8-8f2a-5edf4ed63229 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.201895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375048-ecd0-45d8-8f2a-5edf4ed63229 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.202163 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375048-ecd0-45d8-8f2a-5edf4ed63229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.219623 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a1375048-ecd0-45d8-8f2a-5edf4ed63229 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:27.220851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a1375048-ecd0-45d8-8f2a-5edf4ed63229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:27.262214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829c373-f05e-40a0-a48a-39f5c9a594b0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:27.264418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0829c373-f05e-40a0-a48a-39f5c9a594b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:27.286329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1194/2362] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:27.296512 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1375048-ecd0-45d8-8f2a-5edf4ed63229 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:27.298283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a1375048-ecd0-45d8-8f2a-5edf4ed63229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:27.329409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829c373-f05e-40a0-a48a-39f5c9a594b0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:27.336168 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96494fb1-8c90-4f1d-bab9-78736f6f41b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:27.337035 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96494fb1-8c90-4f1d-bab9-78736f6f41b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.337318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96494fb1-8c90-4f1d-bab9-78736f6f41b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.337597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96494fb1-8c90-4f1d-bab9-78736f6f41b9 admin admin] PATH_INFO: `/v3/projects/4695ddebbe9e465dade0d517c0e3da53` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.338796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96494fb1-8c90-4f1d-bab9-78736f6f41b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4695ddebbe9e465dade0d517c0e3da53)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:27.340744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96494fb1-8c90-4f1d-bab9-78736f6f41b9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:27.357453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1375048-ecd0-45d8-8f2a-5edf4ed63229 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:27.361509 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d426655-7c49-41ac-a203-20ad0464f5b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:27.362381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d426655-7c49-41ac-a203-20ad0464f5b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.362861 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d426655-7c49-41ac-a203-20ad0464f5b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.363135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d426655-7c49-41ac-a203-20ad0464f5b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.374620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d426655-7c49-41ac-a203-20ad0464f5b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:27.376147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d426655-7c49-41ac-a203-20ad0464f5b3 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:27.387086 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1195/2363] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:32:27.392325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-96494fb1-8c90-4f1d-bab9-78736f6f41b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4695ddebbe9e465dade0d517c0e3da53', 'request_id': 'req-96494fb1-8c90-4f1d-bab9-78736f6f41b9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:27.397624 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-96494fb1-8c90-4f1d-bab9-78736f6f41b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4695ddebbe9e465dade0d517c0e3da53', 'request_id': 'req-96494fb1-8c90-4f1d-bab9-78736f6f41b9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:27.403606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-96494fb1-8c90-4f1d-bab9-78736f6f41b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4695ddebbe9e465dade0d517c0e3da53', 'request_id': 'req-96494fb1-8c90-4f1d-bab9-78736f6f41b9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:27.417895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-96494fb1-8c90-4f1d-bab9-78736f6f41b9 admin admin] The token cache is being invalidate because project 4695ddebbe9e465dade0d517c0e3da53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:27.418182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-96494fb1-8c90-4f1d-bab9-78736f6f41b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:27.418835 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-96494fb1-8c90-4f1d-bab9-78736f6f41b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:27.420546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1169/2364] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:27 2022] DELETE /identity/v3/projects/4695ddebbe9e465dade0d517c0e3da53 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:32:27.426514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65320ac8-4d26-482f-a2ab-6fa48b040761 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.426803 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65320ac8-4d26-482f-a2ab-6fa48b040761 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.427074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65320ac8-4d26-482f-a2ab-6fa48b040761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.446551 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-65320ac8-4d26-482f-a2ab-6fa48b040761 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:27.448114 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-65320ac8-4d26-482f-a2ab-6fa48b040761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:27.510919 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1196/2365] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:27.519183 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d555c07-8b40-4082-b8be-98ac9ac247a0 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.519475 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d555c07-8b40-4082-b8be-98ac9ac247a0 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.519783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d555c07-8b40-4082-b8be-98ac9ac247a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.541091 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-3d555c07-8b40-4082-b8be-98ac9ac247a0 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:27.543134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-3d555c07-8b40-4082-b8be-98ac9ac247a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:27.552933 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1170/2366] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:27.557547 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65320ac8-4d26-482f-a2ab-6fa48b040761 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:27.567689 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65320ac8-4d26-482f-a2ab-6fa48b040761 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:27.573715 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc3117-6be9-4471-a471-ba470d9b74d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:27.574369 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc3117-6be9-4471-a471-ba470d9b74d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.574650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc3117-6be9-4471-a471-ba470d9b74d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.574922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc3117-6be9-4471-a471-ba470d9b74d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.575634 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc3117-6be9-4471-a471-ba470d9b74d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:32:27.575952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc3117-6be9-4471-a471-ba470d9b74d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:27.577561 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc3117-6be9-4471-a471-ba470d9b74d4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:27.589808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1197/2367] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:32:27.594126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d555c07-8b40-4082-b8be-98ac9ac247a0 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:27.604110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d555c07-8b40-4082-b8be-98ac9ac247a0 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:27.609020 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856feed4-b2b9-4b5a-9fc8-87ba0222309c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:27.609661 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856feed4-b2b9-4b5a-9fc8-87ba0222309c admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.609942 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856feed4-b2b9-4b5a-9fc8-87ba0222309c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.610213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856feed4-b2b9-4b5a-9fc8-87ba0222309c admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.610897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856feed4-b2b9-4b5a-9fc8-87ba0222309c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:27.612840 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856feed4-b2b9-4b5a-9fc8-87ba0222309c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:27.638804 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1171/2368] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:27 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:27.642868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc3117-6be9-4471-a471-ba470d9b74d4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:27.652893 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc3117-6be9-4471-a471-ba470d9b74d4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:27.710430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d518-6d07-43cf-8345-436edb04ad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:27.711133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d518-6d07-43cf-8345-436edb04ad70 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.711415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d518-6d07-43cf-8345-436edb04ad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.711693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d518-6d07-43cf-8345-436edb04ad70 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.712428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745d518-6d07-43cf-8345-436edb04ad70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:27.714623 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745d518-6d07-43cf-8345-436edb04ad70 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:27.739954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1198/2369] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:27 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:27.741776 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856feed4-b2b9-4b5a-9fc8-87ba0222309c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:27.753599 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856feed4-b2b9-4b5a-9fc8-87ba0222309c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:27.759864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916c528-d8aa-4d32-9ac5-d8564d1f1a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:27.760858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916c528-d8aa-4d32-9ac5-d8564d1f1a9d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.761361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916c528-d8aa-4d32-9ac5-d8564d1f1a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.761974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916c528-d8aa-4d32-9ac5-d8564d1f1a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.763169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916c528-d8aa-4d32-9ac5-d8564d1f1a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:27.765259 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916c528-d8aa-4d32-9ac5-d8564d1f1a9d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:27.778361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1172/2370] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:32:27.782299 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d518-6d07-43cf-8345-436edb04ad70 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:27.794353 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d518-6d07-43cf-8345-436edb04ad70 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:27.799546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314e371-6960-45df-9b99-cc305ff1d440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:27.800200 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314e371-6960-45df-9b99-cc305ff1d440 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.800482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314e371-6960-45df-9b99-cc305ff1d440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.800762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314e371-6960-45df-9b99-cc305ff1d440 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.801665 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314e371-6960-45df-9b99-cc305ff1d440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:27.803409 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4314e371-6960-45df-9b99-cc305ff1d440 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:27.821168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1199/2371] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:27.825424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916c528-d8aa-4d32-9ac5-d8564d1f1a9d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:27.838837 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916c528-d8aa-4d32-9ac5-d8564d1f1a9d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:27.844744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468deef8-2a25-4849-9fd7-03ca66d35aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:27.845802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468deef8-2a25-4849-9fd7-03ca66d35aea admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.845972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468deef8-2a25-4849-9fd7-03ca66d35aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.846274 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468deef8-2a25-4849-9fd7-03ca66d35aea admin admin] PATH_INFO: `/v3/projects/7e3398fd31a7491f9db40c9f66f542f0/users/d6d76d9f999d4328a8517d8bdf35284e/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.864039 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468deef8-2a25-4849-9fd7-03ca66d35aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3398fd31a7491f9db40c9f66f542f0, user_id=d6d76d9f999d4328a8517d8bdf35284e, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:27.867530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468deef8-2a25-4849-9fd7-03ca66d35aea admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:27.880916 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1173/2372] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:27 2022] PUT /identity/v3/projects/7e3398fd31a7491f9db40c9f66f542f0/users/d6d76d9f999d4328a8517d8bdf35284e/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:27.892808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0063b-8f31-4f93-b9a9-ee610fdc0acf None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:27.893053 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0063b-8f31-4f93-b9a9-ee610fdc0acf None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:27.893330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0063b-8f31-4f93-b9a9-ee610fdc0acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:27.927771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7ff0063b-8f31-4f93-b9a9-ee610fdc0acf None None] MFA Rules not processed for user `d6d76d9f999d4328a8517d8bdf35284e`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:27.930221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7ff0063b-8f31-4f93-b9a9-ee610fdc0acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:28.014381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1200/2373] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:28.016264 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468deef8-2a25-4849-9fd7-03ca66d35aea admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:28.018824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-468deef8-2a25-4849-9fd7-03ca66d35aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:28.093997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468deef8-2a25-4849-9fd7-03ca66d35aea admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:28.095504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac52ff-ac18-42a7-a089-fcca5dcaaa94 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:28.095800 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac52ff-ac18-42a7-a089-fcca5dcaaa94 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:28.096110 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac52ff-ac18-42a7-a089-fcca5dcaaa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:28.096600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd923c4-a8a6-4e71-9be0-e3a0ca0e7dc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:28.097311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd923c4-a8a6-4e71-9be0-e3a0ca0e7dc9 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:28.097591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd923c4-a8a6-4e71-9be0-e3a0ca0e7dc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:28.097867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd923c4-a8a6-4e71-9be0-e3a0ca0e7dc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:28.113516 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd923c4-a8a6-4e71-9be0-e3a0ca0e7dc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:28.114969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd923c4-a8a6-4e71-9be0-e3a0ca0e7dc9 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:28.127624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-93ac52ff-ac18-42a7-a089-fcca5dcaaa94 None None] MFA Rules not processed for user `141fd927383e4ac49831bfe9ff92df56`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:28.129204 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-93ac52ff-ac18-42a7-a089-fcca5dcaaa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:28.144244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1174/2374] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:28.205734 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1201/2375] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:28.210965 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd923c4-a8a6-4e71-9be0-e3a0ca0e7dc9 service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:28.212557 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-cdd923c4-a8a6-4e71-9be0-e3a0ca0e7dc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:28.302847 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd923c4-a8a6-4e71-9be0-e3a0ca0e7dc9 service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:28.308208 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f84e4-06be-42d8-a370-66ad862594dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:28.308884 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f84e4-06be-42d8-a370-66ad862594dd admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:28.309166 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f84e4-06be-42d8-a370-66ad862594dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:28.309443 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f84e4-06be-42d8-a370-66ad862594dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:28.310139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f84e4-06be-42d8-a370-66ad862594dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:28.312060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f84e4-06be-42d8-a370-66ad862594dd admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:28.344199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1175/2376] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:28 2022] POST /identity/v3/projects => generated 405 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:28.347714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac52ff-ac18-42a7-a089-fcca5dcaaa94 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:28.360923 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac52ff-ac18-42a7-a089-fcca5dcaaa94 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:28.442590 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e65919-5a21-4463-9986-189def80b07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:28.445324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e65919-5a21-4463-9986-189def80b07e admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:28.448900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e65919-5a21-4463-9986-189def80b07e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:28.448900 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e65919-5a21-4463-9986-189def80b07e admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:28.449969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e65919-5a21-4463-9986-189def80b07e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:28.453977 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e65919-5a21-4463-9986-189def80b07e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:28.479875 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1202/2377] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:28 2022] POST /identity/v3/users => generated 309 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:28.481240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f84e4-06be-42d8-a370-66ad862594dd admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:28.493213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f84e4-06be-42d8-a370-66ad862594dd admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:28.497977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bbc21-5d89-483d-a2d9-2d3e24ba8909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:28.498634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bbc21-5d89-483d-a2d9-2d3e24ba8909 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:28.498912 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bbc21-5d89-483d-a2d9-2d3e24ba8909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:28.499182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bbc21-5d89-483d-a2d9-2d3e24ba8909 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:28.499892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bbc21-5d89-483d-a2d9-2d3e24ba8909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:28.501497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290bbc21-5d89-483d-a2d9-2d3e24ba8909 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:28.512922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1176/2378] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:32:28.516994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e65919-5a21-4463-9986-189def80b07e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:28.528767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e65919-5a21-4463-9986-189def80b07e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:28.535527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb9f63-8e86-404e-af00-f48a4ab4370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:28.536451 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb9f63-8e86-404e-af00-f48a4ab4370c admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:28.536732 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb9f63-8e86-404e-af00-f48a4ab4370c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:28.537009 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb9f63-8e86-404e-af00-f48a4ab4370c admin admin] PATH_INFO: `/v3/projects/1e81a2e426f0448fba46b2150bf47583/users/93b8d925982147dab19042d0164714a8/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:28.553158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb9f63-8e86-404e-af00-f48a4ab4370c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e81a2e426f0448fba46b2150bf47583, user_id=93b8d925982147dab19042d0164714a8, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:28.556916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb9f63-8e86-404e-af00-f48a4ab4370c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:28.570734 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1203/2379] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:28 2022] PUT /identity/v3/projects/1e81a2e426f0448fba46b2150bf47583/users/93b8d925982147dab19042d0164714a8/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:28.574732 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bbc21-5d89-483d-a2d9-2d3e24ba8909 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:28.586976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bbc21-5d89-483d-a2d9-2d3e24ba8909 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:28.643781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a020c-5da8-43de-93ee-814fd37d184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:28.644610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a020c-5da8-43de-93ee-814fd37d184a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:28.644895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a020c-5da8-43de-93ee-814fd37d184a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:28.645179 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a020c-5da8-43de-93ee-814fd37d184a admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:28.645888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a020c-5da8-43de-93ee-814fd37d184a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:28.647761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a020c-5da8-43de-93ee-814fd37d184a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:28.657462 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1177/2380] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:28.662071 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb9f63-8e86-404e-af00-f48a4ab4370c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:28.672818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb9f63-8e86-404e-af00-f48a4ab4370c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:28.677363 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5e2a7-ae5d-4871-9ca0-a6e996893a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:28.678330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5e2a7-ae5d-4871-9ca0-a6e996893a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:28.679329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5e2a7-ae5d-4871-9ca0-a6e996893a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:28.679705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5e2a7-ae5d-4871-9ca0-a6e996893a41 admin admin] PATH_INFO: `/v3/projects/1e81a2e426f0448fba46b2150bf47583/users/93b8d925982147dab19042d0164714a8/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:28.681652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5e2a7-ae5d-4871-9ca0-a6e996893a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e81a2e426f0448fba46b2150bf47583, user_id=93b8d925982147dab19042d0164714a8, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:28.684334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5e2a7-ae5d-4871-9ca0-a6e996893a41 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:28.694337 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1204/2381] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:28 2022] PUT /identity/v3/projects/1e81a2e426f0448fba46b2150bf47583/users/93b8d925982147dab19042d0164714a8/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:32:28.821471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a020c-5da8-43de-93ee-814fd37d184a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:28.823584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-252a020c-5da8-43de-93ee-814fd37d184a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:28.921238 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a020c-5da8-43de-93ee-814fd37d184a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:28.989308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bf4e3-2f06-45d4-8394-0a9448e6ba73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:28.989969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bf4e3-2f06-45d4-8394-0a9448e6ba73 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:28.990243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bf4e3-2f06-45d4-8394-0a9448e6ba73 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:28.990528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bf4e3-2f06-45d4-8394-0a9448e6ba73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:28.992626 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f64bf4e3-2f06-45d4-8394-0a9448e6ba73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:29.069523 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bf4e3-2f06-45d4-8394-0a9448e6ba73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:29.071139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64bf4e3-2f06-45d4-8394-0a9448e6ba73 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:29.083286 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1178/2382] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:29.374312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fce0d6-f4c6-43e0-bb00-43bc362f895b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:29.374835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fce0d6-f4c6-43e0-bb00-43bc362f895b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:29.374835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fce0d6-f4c6-43e0-bb00-43bc362f895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:29.401768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-05fce0d6-f4c6-43e0-bb00-43bc362f895b None None] MFA Rules not processed for user `93b8d925982147dab19042d0164714a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:29.402963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-05fce0d6-f4c6-43e0-bb00-43bc362f895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:29.471078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1205/2383] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:30.581831 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bf4e3-2f06-45d4-8394-0a9448e6ba73 service nova] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:30.651934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bf4e3-2f06-45d4-8394-0a9448e6ba73 service nova] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:30.656568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:30.657435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:30.657717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:30.657994 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] PATH_INFO: `/v3/users/141fd927383e4ac49831bfe9ff92df56` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:30.659551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=141fd927383e4ac49831bfe9ff92df56)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:30.661520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:30.706566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141fd927383e4ac49831bfe9ff92df56'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:30.718391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141fd927383e4ac49831bfe9ff92df56'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:30.726097 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141fd927383e4ac49831bfe9ff92df56'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:30.733385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141fd927383e4ac49831bfe9ff92df56'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:30.734278 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141fd927383e4ac49831bfe9ff92df56'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:30.743854 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1179/2384] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:30 2022] DELETE /identity/v3/users/141fd927383e4ac49831bfe9ff92df56 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:30.907743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fce0d6-f4c6-43e0-bb00-43bc362f895b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:30.924683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fce0d6-f4c6-43e0-bb00-43bc362f895b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:30.979961 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:30.980833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:30.981115 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:30.981388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] PATH_INFO: `/v3/projects/b2d578f0dcd149abbd283b0722d54bc4` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:30.982562 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d578f0dcd149abbd283b0722d54bc4)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:30.984502 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:31.035972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d578f0dcd149abbd283b0722d54bc4', 'request_id': 'req-c85d30cc-e66b-4abd-9a54-3194fd29077c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.041469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d578f0dcd149abbd283b0722d54bc4', 'request_id': 'req-c85d30cc-e66b-4abd-9a54-3194fd29077c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.047561 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d578f0dcd149abbd283b0722d54bc4', 'request_id': 'req-c85d30cc-e66b-4abd-9a54-3194fd29077c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.060124 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] The token cache is being invalidate because project b2d578f0dcd149abbd283b0722d54bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:31.060410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.061032 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.062542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1206/2385] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:30 2022] DELETE /identity/v3/projects/b2d578f0dcd149abbd283b0722d54bc4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:31.066622 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:31.068191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:31.081849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f528d9-3a32-493a-b719-641aa9d51e1f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:31.140327 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62c309-5d2d-4147-ac6b-3ba98197f284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:31.141145 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62c309-5d2d-4147-ac6b-3ba98197f284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:31.141429 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62c309-5d2d-4147-ac6b-3ba98197f284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:31.141705 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62c309-5d2d-4147-ac6b-3ba98197f284 admin admin] PATH_INFO: `/v3/users/93b8d925982147dab19042d0164714a8` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:31.142880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62c309-5d2d-4147-ac6b-3ba98197f284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b8d925982147dab19042d0164714a8)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:31.144862 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62c309-5d2d-4147-ac6b-3ba98197f284 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:31.187817 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-4e62c309-5d2d-4147-ac6b-3ba98197f284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b8d925982147dab19042d0164714a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.204308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-4e62c309-5d2d-4147-ac6b-3ba98197f284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b8d925982147dab19042d0164714a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.214278 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-4e62c309-5d2d-4147-ac6b-3ba98197f284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b8d925982147dab19042d0164714a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.227733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-4e62c309-5d2d-4147-ac6b-3ba98197f284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b8d925982147dab19042d0164714a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.227733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-4e62c309-5d2d-4147-ac6b-3ba98197f284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b8d925982147dab19042d0164714a8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.232646 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1180/2386] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:31 2022] DELETE /identity/v3/users/93b8d925982147dab19042d0164714a8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:31.430849 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:31.432637 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:31.446907 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d30cc-e66b-4abd-9a54-3194fd29077c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:31.511216 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dab90c-534b-4165-b37c-14f12db23998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:31.512279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab90c-534b-4165-b37c-14f12db23998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:31.512569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab90c-534b-4165-b37c-14f12db23998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:31.513575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dab90c-534b-4165-b37c-14f12db23998 admin admin] PATH_INFO: `/v3/projects/1e81a2e426f0448fba46b2150bf47583` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:31.514030 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dab90c-534b-4165-b37c-14f12db23998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e81a2e426f0448fba46b2150bf47583)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:31.516130 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dab90c-534b-4165-b37c-14f12db23998 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:31.566355 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-35dab90c-534b-4165-b37c-14f12db23998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e81a2e426f0448fba46b2150bf47583', 'request_id': 'req-35dab90c-534b-4165-b37c-14f12db23998'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.573763 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-35dab90c-534b-4165-b37c-14f12db23998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e81a2e426f0448fba46b2150bf47583', 'request_id': 'req-35dab90c-534b-4165-b37c-14f12db23998'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.587561 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-35dab90c-534b-4165-b37c-14f12db23998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e81a2e426f0448fba46b2150bf47583', 'request_id': 'req-35dab90c-534b-4165-b37c-14f12db23998'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.600201 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-35dab90c-534b-4165-b37c-14f12db23998 admin admin] The token cache is being invalidate because project 1e81a2e426f0448fba46b2150bf47583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:31.601129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-35dab90c-534b-4165-b37c-14f12db23998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.601756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-35dab90c-534b-4165-b37c-14f12db23998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:31.603278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1207/2387] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:31 2022] DELETE /identity/v3/projects/1e81a2e426f0448fba46b2150bf47583 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:31.608683 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ab369-17d5-4660-a186-ae6e45d05202 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:31.609192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ab369-17d5-4660-a186-ae6e45d05202 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:31.609292 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ab369-17d5-4660-a186-ae6e45d05202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:31.629457 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0a0ab369-17d5-4660-a186-ae6e45d05202 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:31.630514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0a0ab369-17d5-4660-a186-ae6e45d05202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:31.705665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1181/2388] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:31.714141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee01207-31ac-48f2-bb18-0e06076634fd None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:31.714529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee01207-31ac-48f2-bb18-0e06076634fd None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:31.714878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee01207-31ac-48f2-bb18-0e06076634fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:31.737509 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-eee01207-31ac-48f2-bb18-0e06076634fd None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:31.739078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-eee01207-31ac-48f2-bb18-0e06076634fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:31.751906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1208/2389] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:31.757972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ab369-17d5-4660-a186-ae6e45d05202 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:31.774590 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ab369-17d5-4660-a186-ae6e45d05202 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:31.779484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622d691-6ae7-4e7f-9144-cc2994c8a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:31.780184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622d691-6ae7-4e7f-9144-cc2994c8a79b admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:31.780475 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622d691-6ae7-4e7f-9144-cc2994c8a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:31.780752 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622d691-6ae7-4e7f-9144-cc2994c8a79b admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:31.781480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622d691-6ae7-4e7f-9144-cc2994c8a79b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:32:31.781786 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622d691-6ae7-4e7f-9144-cc2994c8a79b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:31.783962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622d691-6ae7-4e7f-9144-cc2994c8a79b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:31.800201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1182/2390] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:32:31.801372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee01207-31ac-48f2-bb18-0e06076634fd None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:31.814459 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee01207-31ac-48f2-bb18-0e06076634fd None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:31.820616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fe7f5-3418-47b1-b69f-2b044431ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:31.821530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fe7f5-3418-47b1-b69f-2b044431ad2c admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:31.822146 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fe7f5-3418-47b1-b69f-2b044431ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:31.822628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fe7f5-3418-47b1-b69f-2b044431ad2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:31.823373 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fe7f5-3418-47b1-b69f-2b044431ad2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:31.826585 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fe7f5-3418-47b1-b69f-2b044431ad2c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:31.865720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1209/2391] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:31 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:31.868579 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622d691-6ae7-4e7f-9144-cc2994c8a79b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:31.878983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622d691-6ae7-4e7f-9144-cc2994c8a79b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:31.947946 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca11910-4447-4a72-931a-798f422a63ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:31.948700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca11910-4447-4a72-931a-798f422a63ae admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:31.948983 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca11910-4447-4a72-931a-798f422a63ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:31.949260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca11910-4447-4a72-931a-798f422a63ae admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:31.949997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca11910-4447-4a72-931a-798f422a63ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:31.951952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca11910-4447-4a72-931a-798f422a63ae admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:31.972967 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1183/2392] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:31 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:31.977872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fe7f5-3418-47b1-b69f-2b044431ad2c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:31.994076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fe7f5-3418-47b1-b69f-2b044431ad2c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:31.998784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e52c7-5947-4b88-a206-74f34f73f605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:31.999452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e52c7-5947-4b88-a206-74f34f73f605 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:31.999736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e52c7-5947-4b88-a206-74f34f73f605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.007268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e52c7-5947-4b88-a206-74f34f73f605 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.007268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e52c7-5947-4b88-a206-74f34f73f605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:32.007268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e52c7-5947-4b88-a206-74f34f73f605 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:32.018518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1210/2393] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:32.022561 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca11910-4447-4a72-931a-798f422a63ae admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:32.032612 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca11910-4447-4a72-931a-798f422a63ae admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:32.037656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6441fd-3915-48b8-871f-ce389f5e7c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:32.038389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6441fd-3915-48b8-871f-ce389f5e7c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:32.038672 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6441fd-3915-48b8-871f-ce389f5e7c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.038977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6441fd-3915-48b8-871f-ce389f5e7c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.039697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6441fd-3915-48b8-871f-ce389f5e7c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:32.041330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6441fd-3915-48b8-871f-ce389f5e7c11 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:32.051524 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1184/2394] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:32.057264 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e52c7-5947-4b88-a206-74f34f73f605 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:32.067046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e52c7-5947-4b88-a206-74f34f73f605 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:32.072328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff97186-8906-4a03-9cc7-6f656422f01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:32.073189 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff97186-8906-4a03-9cc7-6f656422f01a admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:32.073465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff97186-8906-4a03-9cc7-6f656422f01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.073736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff97186-8906-4a03-9cc7-6f656422f01a admin admin] PATH_INFO: `/v3/projects/09af9a746cd048c69c78c53b47f9127e/users/81397b047ab94efc9d1e57fb42656a47/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.087872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff97186-8906-4a03-9cc7-6f656422f01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=09af9a746cd048c69c78c53b47f9127e, user_id=81397b047ab94efc9d1e57fb42656a47, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:32.090590 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff97186-8906-4a03-9cc7-6f656422f01a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:32.104356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1211/2395] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:32 2022] PUT /identity/v3/projects/09af9a746cd048c69c78c53b47f9127e/users/81397b047ab94efc9d1e57fb42656a47/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:32:32.114501 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793b9c6-dd41-4b0c-9e22-0632ead86335 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:32.114789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793b9c6-dd41-4b0c-9e22-0632ead86335 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.115087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793b9c6-dd41-4b0c-9e22-0632ead86335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.143642 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-7793b9c6-dd41-4b0c-9e22-0632ead86335 None None] MFA Rules not processed for user `81397b047ab94efc9d1e57fb42656a47`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:32.145302 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-7793b9c6-dd41-4b0c-9e22-0632ead86335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:32.208314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1185/2396] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:32.213005 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff97186-8906-4a03-9cc7-6f656422f01a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:32.273315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff97186-8906-4a03-9cc7-6f656422f01a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:32.277950 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cc676-0ad0-40ae-8350-c812c74f7cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:32.278602 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc676-0ad0-40ae-8350-c812c74f7cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:32.278884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc676-0ad0-40ae-8350-c812c74f7cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.279161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc676-0ad0-40ae-8350-c812c74f7cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.279851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cc676-0ad0-40ae-8350-c812c74f7cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:32.281771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cc676-0ad0-40ae-8350-c812c74f7cf5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:32.306855 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1212/2397] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:32 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:32.310899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793b9c6-dd41-4b0c-9e22-0632ead86335 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:32.321709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793b9c6-dd41-4b0c-9e22-0632ead86335 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:32.376452 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e369d3d-f239-4026-ac6e-677e66b6c3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:32.377241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e369d3d-f239-4026-ac6e-677e66b6c3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:32.377529 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e369d3d-f239-4026-ac6e-677e66b6c3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.377806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e369d3d-f239-4026-ac6e-677e66b6c3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.378497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e369d3d-f239-4026-ac6e-677e66b6c3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:32.380452 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e369d3d-f239-4026-ac6e-677e66b6c3d0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:32.402778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1186/2398] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:32 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:32.403984 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cc676-0ad0-40ae-8350-c812c74f7cf5 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:32.414760 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cc676-0ad0-40ae-8350-c812c74f7cf5 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:32.419775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c5fdb-9349-48c8-a529-b4f928ae4611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:32.420458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c5fdb-9349-48c8-a529-b4f928ae4611 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:32.420744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c5fdb-9349-48c8-a529-b4f928ae4611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.421020 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c5fdb-9349-48c8-a529-b4f928ae4611 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.421743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c5fdb-9349-48c8-a529-b4f928ae4611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:32.423328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c5fdb-9349-48c8-a529-b4f928ae4611 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:32.434516 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1213/2399] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:32.438679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e369d3d-f239-4026-ac6e-677e66b6c3d0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:32.450011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e369d3d-f239-4026-ac6e-677e66b6c3d0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:32.454528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5db86a-ea9d-416f-93a1-9c1aa17ba774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:32.455388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5db86a-ea9d-416f-93a1-9c1aa17ba774 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:32.455665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5db86a-ea9d-416f-93a1-9c1aa17ba774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.455931 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5db86a-ea9d-416f-93a1-9c1aa17ba774 admin admin] PATH_INFO: `/v3/projects/69b2f2c93aec401da908c65c2bdedd4c/users/5daadcf6bab2415eb95f242072f60120/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.470646 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5db86a-ea9d-416f-93a1-9c1aa17ba774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b2f2c93aec401da908c65c2bdedd4c, user_id=5daadcf6bab2415eb95f242072f60120, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:32.473365 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5db86a-ea9d-416f-93a1-9c1aa17ba774 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:32.486514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1187/2400] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:32 2022] PUT /identity/v3/projects/69b2f2c93aec401da908c65c2bdedd4c/users/5daadcf6bab2415eb95f242072f60120/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:32.490595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c5fdb-9349-48c8-a529-b4f928ae4611 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:32.501324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c5fdb-9349-48c8-a529-b4f928ae4611 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:32.555758 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f5b55-8236-4763-aad2-1fc5eadf507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:32.556370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f5b55-8236-4763-aad2-1fc5eadf507f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:32.556653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f5b55-8236-4763-aad2-1fc5eadf507f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.556933 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f5b55-8236-4763-aad2-1fc5eadf507f admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.557652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f5b55-8236-4763-aad2-1fc5eadf507f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:32.559233 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f5b55-8236-4763-aad2-1fc5eadf507f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:32.568641 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1214/2401] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:32.573042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5db86a-ea9d-416f-93a1-9c1aa17ba774 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:32.583232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5db86a-ea9d-416f-93a1-9c1aa17ba774 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:32.588563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f75ce-dbbb-46cf-b71b-4c7a7205bd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:32.589434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f75ce-dbbb-46cf-b71b-4c7a7205bd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:32.589716 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f75ce-dbbb-46cf-b71b-4c7a7205bd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.589994 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f75ce-dbbb-46cf-b71b-4c7a7205bd7d admin admin] PATH_INFO: `/v3/projects/69b2f2c93aec401da908c65c2bdedd4c/users/5daadcf6bab2415eb95f242072f60120/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.591962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f75ce-dbbb-46cf-b71b-4c7a7205bd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b2f2c93aec401da908c65c2bdedd4c, user_id=5daadcf6bab2415eb95f242072f60120, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:32.594645 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f75ce-dbbb-46cf-b71b-4c7a7205bd7d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:32.606385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1188/2402] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:32 2022] PUT /identity/v3/projects/69b2f2c93aec401da908c65c2bdedd4c/users/5daadcf6bab2415eb95f242072f60120/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:32.617421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628d281-8a67-4f1b-80df-cdfb3597057f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:32.617708 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628d281-8a67-4f1b-80df-cdfb3597057f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.617983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628d281-8a67-4f1b-80df-cdfb3597057f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.643947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4628d281-8a67-4f1b-80df-cdfb3597057f None None] MFA Rules not processed for user `5daadcf6bab2415eb95f242072f60120`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:32.645150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4628d281-8a67-4f1b-80df-cdfb3597057f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:32.711194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1215/2403] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:32.720722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f75ce-dbbb-46cf-b71b-4c7a7205bd7d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:32.722509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-059f75ce-dbbb-46cf-b71b-4c7a7205bd7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:32.781112 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f75ce-dbbb-46cf-b71b-4c7a7205bd7d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:32.784802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15db61-4682-4187-96ac-cfbb1cfacb04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:32.785439 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15db61-4682-4187-96ac-cfbb1cfacb04 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:32.785723 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15db61-4682-4187-96ac-cfbb1cfacb04 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.785998 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15db61-4682-4187-96ac-cfbb1cfacb04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.795505 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15db61-4682-4187-96ac-cfbb1cfacb04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:32.796961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15db61-4682-4187-96ac-cfbb1cfacb04 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:32.807180 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1189/2404] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:32.878239 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628d281-8a67-4f1b-80df-cdfb3597057f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:32.888051 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628d281-8a67-4f1b-80df-cdfb3597057f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:32.893621 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8fcd5-4d0e-4031-9e3a-4fa11c9708de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:32.894269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8fcd5-4d0e-4031-9e3a-4fa11c9708de service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:32.894552 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8fcd5-4d0e-4031-9e3a-4fa11c9708de service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:32.894825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8fcd5-4d0e-4031-9e3a-4fa11c9708de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:32.953712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8fcd5-4d0e-4031-9e3a-4fa11c9708de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:32.955182 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8fcd5-4d0e-4031-9e3a-4fa11c9708de service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:32.964341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1216/2405] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:37.394012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15db61-4682-4187-96ac-cfbb1cfacb04 service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:37.395418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-5a15db61-4682-4187-96ac-cfbb1cfacb04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:37.461036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15db61-4682-4187-96ac-cfbb1cfacb04 service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:37.464593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941c308-576e-44a6-8e40-54d166a9da2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:37.465223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941c308-576e-44a6-8e40-54d166a9da2d service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:37.465500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941c308-576e-44a6-8e40-54d166a9da2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:37.465771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941c308-576e-44a6-8e40-54d166a9da2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:37.467487 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0941c308-576e-44a6-8e40-54d166a9da2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:37.477247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941c308-576e-44a6-8e40-54d166a9da2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:37.478709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941c308-576e-44a6-8e40-54d166a9da2d service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:37.486531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1190/2406] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:47.924560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8fcd5-4d0e-4031-9e3a-4fa11c9708de service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:47.985257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8fcd5-4d0e-4031-9e3a-4fa11c9708de service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:47.989795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:47.990655 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:47.990938 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:47.991213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] PATH_INFO: `/v3/users/81397b047ab94efc9d1e57fb42656a47` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:47.992443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=81397b047ab94efc9d1e57fb42656a47)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:47.995028 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:48.041629 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81397b047ab94efc9d1e57fb42656a47'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.052428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81397b047ab94efc9d1e57fb42656a47'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.053327 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81397b047ab94efc9d1e57fb42656a47'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.060247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81397b047ab94efc9d1e57fb42656a47'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.066770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81397b047ab94efc9d1e57fb42656a47'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.072918 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1217/2407] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:47 2022] DELETE /identity/v3/users/81397b047ab94efc9d1e57fb42656a47 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:48.077344 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e24601-ee74-4519-b29f-cffec0900520 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:48.077814 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e24601-ee74-4519-b29f-cffec0900520 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:48.077938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e24601-ee74-4519-b29f-cffec0900520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:48.095377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-d6e24601-ee74-4519-b29f-cffec0900520 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:48.096575 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d6e24601-ee74-4519-b29f-cffec0900520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:48.152379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1191/2408] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:48.162109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:48.163494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:48.219027 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fe086-885a-4a3a-bfcf-20cde8613afc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:48.222712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fa779-0172-4a58-9504-22863ba9d16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:48.223346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fa779-0172-4a58-9504-22863ba9d16b service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:48.223630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fa779-0172-4a58-9504-22863ba9d16b service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:48.223906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fa779-0172-4a58-9504-22863ba9d16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:48.233402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fa779-0172-4a58-9504-22863ba9d16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:48.234844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fa779-0172-4a58-9504-22863ba9d16b service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:48.244943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1218/2409] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:48.520290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e24601-ee74-4519-b29f-cffec0900520 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:48.521833 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d6e24601-ee74-4519-b29f-cffec0900520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:48.534056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e24601-ee74-4519-b29f-cffec0900520 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:48.538924 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:48.539775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:48.540081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:48.541072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] PATH_INFO: `/v3/projects/09af9a746cd048c69c78c53b47f9127e` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:48.542317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] RBAC: Authorizing `identity:delete_project(project_id=09af9a746cd048c69c78c53b47f9127e)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:48.544294 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:48.591509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09af9a746cd048c69c78c53b47f9127e', 'request_id': 'req-1d3e602b-cddd-4dcb-81bc-5918739c97be'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.596734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09af9a746cd048c69c78c53b47f9127e', 'request_id': 'req-1d3e602b-cddd-4dcb-81bc-5918739c97be'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.603312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09af9a746cd048c69c78c53b47f9127e', 'request_id': 'req-1d3e602b-cddd-4dcb-81bc-5918739c97be'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.615294 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] The token cache is being invalidate because project 09af9a746cd048c69c78c53b47f9127e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:48.615580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.616266 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.619044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1192/2410] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:48 2022] DELETE /identity/v3/projects/09af9a746cd048c69c78c53b47f9127e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:48.622510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fa779-0172-4a58-9504-22863ba9d16b service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:48.632054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fa779-0172-4a58-9504-22863ba9d16b service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:48.692961 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1dae0-65b3-44d9-8105-399db29ddf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:48.693866 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1dae0-65b3-44d9-8105-399db29ddf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:48.694173 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1dae0-65b3-44d9-8105-399db29ddf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:48.694461 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1dae0-65b3-44d9-8105-399db29ddf2f admin admin] PATH_INFO: `/v3/users/5daadcf6bab2415eb95f242072f60120` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:48.695649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1dae0-65b3-44d9-8105-399db29ddf2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5daadcf6bab2415eb95f242072f60120)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:48.698381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1dae0-65b3-44d9-8105-399db29ddf2f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:48.741446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bbb1dae0-65b3-44d9-8105-399db29ddf2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5daadcf6bab2415eb95f242072f60120'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.752595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bbb1dae0-65b3-44d9-8105-399db29ddf2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5daadcf6bab2415eb95f242072f60120'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.753473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bbb1dae0-65b3-44d9-8105-399db29ddf2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5daadcf6bab2415eb95f242072f60120'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.760048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bbb1dae0-65b3-44d9-8105-399db29ddf2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5daadcf6bab2415eb95f242072f60120'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.767354 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bbb1dae0-65b3-44d9-8105-399db29ddf2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5daadcf6bab2415eb95f242072f60120'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:48.773122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1219/2411] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:48 2022] DELETE /identity/v3/users/5daadcf6bab2415eb95f242072f60120 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:49.034867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:49.036495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:49.050192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e602b-cddd-4dcb-81bc-5918739c97be admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:49.106480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2914bc-2d92-4687-89af-23b173bfea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:49.107342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2914bc-2d92-4687-89af-23b173bfea32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:49.107630 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2914bc-2d92-4687-89af-23b173bfea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:49.107905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2914bc-2d92-4687-89af-23b173bfea32 admin admin] PATH_INFO: `/v3/projects/69b2f2c93aec401da908c65c2bdedd4c` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:49.109114 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2914bc-2d92-4687-89af-23b173bfea32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b2f2c93aec401da908c65c2bdedd4c)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:49.111110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2914bc-2d92-4687-89af-23b173bfea32 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:49.156976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3e2914bc-2d92-4687-89af-23b173bfea32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b2f2c93aec401da908c65c2bdedd4c', 'request_id': 'req-3e2914bc-2d92-4687-89af-23b173bfea32'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:49.162537 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3e2914bc-2d92-4687-89af-23b173bfea32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b2f2c93aec401da908c65c2bdedd4c', 'request_id': 'req-3e2914bc-2d92-4687-89af-23b173bfea32'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:49.169348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3e2914bc-2d92-4687-89af-23b173bfea32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b2f2c93aec401da908c65c2bdedd4c', 'request_id': 'req-3e2914bc-2d92-4687-89af-23b173bfea32'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:49.181066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3e2914bc-2d92-4687-89af-23b173bfea32 admin admin] The token cache is being invalidate because project 69b2f2c93aec401da908c65c2bdedd4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:49.181350 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3e2914bc-2d92-4687-89af-23b173bfea32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:49.181975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3e2914bc-2d92-4687-89af-23b173bfea32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:49.184244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1193/2412] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:49 2022] DELETE /identity/v3/projects/69b2f2c93aec401da908c65c2bdedd4c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:49.189112 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef6ae6-eb5c-4903-9477-4a8d1d92aecc None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:49.189617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef6ae6-eb5c-4903-9477-4a8d1d92aecc None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:49.189713 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef6ae6-eb5c-4903-9477-4a8d1d92aecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:49.207958 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-eeef6ae6-eb5c-4903-9477-4a8d1d92aecc None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:49.209185 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-eeef6ae6-eb5c-4903-9477-4a8d1d92aecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:49.266163 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1220/2413] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:49.273962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b2f5-318f-4dbd-ae81-d2a5a06298fe None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:49.274251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b2f5-318f-4dbd-ae81-d2a5a06298fe None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:49.274528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74b2f5-318f-4dbd-ae81-d2a5a06298fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:49.294532 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-4c74b2f5-318f-4dbd-ae81-d2a5a06298fe None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:49.295719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4c74b2f5-318f-4dbd-ae81-d2a5a06298fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:49.303507 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1194/2414] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:49.307739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef6ae6-eb5c-4903-9477-4a8d1d92aecc None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:49.317237 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef6ae6-eb5c-4903-9477-4a8d1d92aecc None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:49.321905 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434bb21-19d8-43ec-b9a4-68cf65f85587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:49.322549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434bb21-19d8-43ec-b9a4-68cf65f85587 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:49.323379 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434bb21-19d8-43ec-b9a4-68cf65f85587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:49.323983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434bb21-19d8-43ec-b9a4-68cf65f85587 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:49.324406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434bb21-19d8-43ec-b9a4-68cf65f85587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:32:49.324714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434bb21-19d8-43ec-b9a4-68cf65f85587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:49.326314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434bb21-19d8-43ec-b9a4-68cf65f85587 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:49.338388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1221/2415] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:32:49.343325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b2f5-318f-4dbd-ae81-d2a5a06298fe None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:49.352364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74b2f5-318f-4dbd-ae81-d2a5a06298fe None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:49.357650 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677877ec-dcd7-414f-9304-4aa1b30f06b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:49.358282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677877ec-dcd7-414f-9304-4aa1b30f06b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:49.358558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677877ec-dcd7-414f-9304-4aa1b30f06b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:49.358829 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677877ec-dcd7-414f-9304-4aa1b30f06b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:49.359515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677877ec-dcd7-414f-9304-4aa1b30f06b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:49.361408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677877ec-dcd7-414f-9304-4aa1b30f06b7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:49.386209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1195/2416] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:49 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:49.390198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434bb21-19d8-43ec-b9a4-68cf65f85587 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:49.399795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434bb21-19d8-43ec-b9a4-68cf65f85587 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:49.454519 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c153d-4797-4dd5-8356-d3c079995f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:49.455584 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c153d-4797-4dd5-8356-d3c079995f0c admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:49.455863 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c153d-4797-4dd5-8356-d3c079995f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:49.456615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c153d-4797-4dd5-8356-d3c079995f0c admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:49.457003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c153d-4797-4dd5-8356-d3c079995f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:49.458911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c153d-4797-4dd5-8356-d3c079995f0c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:49.480845 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1222/2417] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:49 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:49.484722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677877ec-dcd7-414f-9304-4aa1b30f06b7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:49.495419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677877ec-dcd7-414f-9304-4aa1b30f06b7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:49.500388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26e858-a469-410d-bffc-9e5a2737402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:49.501042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26e858-a469-410d-bffc-9e5a2737402a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:49.501354 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26e858-a469-410d-bffc-9e5a2737402a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:49.501630 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26e858-a469-410d-bffc-9e5a2737402a admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:49.502346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26e858-a469-410d-bffc-9e5a2737402a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:49.503929 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26e858-a469-410d-bffc-9e5a2737402a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:49.514419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1196/2418] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:49.518362 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c153d-4797-4dd5-8356-d3c079995f0c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:49.528530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c153d-4797-4dd5-8356-d3c079995f0c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:49.534581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ffe57-3944-4585-9b46-14ef1abe50a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:49.534581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ffe57-3944-4585-9b46-14ef1abe50a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:49.534581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ffe57-3944-4585-9b46-14ef1abe50a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:49.534884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ffe57-3944-4585-9b46-14ef1abe50a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:49.535385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ffe57-3944-4585-9b46-14ef1abe50a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:49.537013 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ffe57-3944-4585-9b46-14ef1abe50a3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:49.549773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1223/2419] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:32:49.556536 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26e858-a469-410d-bffc-9e5a2737402a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:49.567533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26e858-a469-410d-bffc-9e5a2737402a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:49.572530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51b3e-32e7-444a-8d7d-a0b871081a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:49.574007 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51b3e-32e7-444a-8d7d-a0b871081a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:49.574349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51b3e-32e7-444a-8d7d-a0b871081a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:49.574812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f51b3e-32e7-444a-8d7d-a0b871081a19 admin admin] PATH_INFO: `/v3/projects/5105cd6acae94ba8a4cad44f95976834/users/fd6f310dcdf743cb9e74d792873b355f/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:49.590069 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51b3e-32e7-444a-8d7d-a0b871081a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5105cd6acae94ba8a4cad44f95976834, user_id=fd6f310dcdf743cb9e74d792873b355f, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:49.592838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f51b3e-32e7-444a-8d7d-a0b871081a19 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:49.607372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1197/2420] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:49 2022] PUT /identity/v3/projects/5105cd6acae94ba8a4cad44f95976834/users/fd6f310dcdf743cb9e74d792873b355f/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:49.618758 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0ae26-91dc-4836-b10a-fb7912fe7f86 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:49.619050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0ae26-91dc-4836-b10a-fb7912fe7f86 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:49.619381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0ae26-91dc-4836-b10a-fb7912fe7f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:49.646609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-78d0ae26-91dc-4836-b10a-fb7912fe7f86 None None] MFA Rules not processed for user `fd6f310dcdf743cb9e74d792873b355f`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:49.656152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-78d0ae26-91dc-4836-b10a-fb7912fe7f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:49.716692 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1224/2421] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:49.736538 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51b3e-32e7-444a-8d7d-a0b871081a19 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:49.738201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-19f51b3e-32e7-444a-8d7d-a0b871081a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:49.808880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f51b3e-32e7-444a-8d7d-a0b871081a19 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:49.812533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e04ac1-c020-484e-b003-6bec8071b184 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5074090dca0b4a49b54dc252a5dd9420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:49.813165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e04ac1-c020-484e-b003-6bec8071b184 service glance] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:49.813442 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e04ac1-c020-484e-b003-6bec8071b184 service glance] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:49.813714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e04ac1-c020-484e-b003-6bec8071b184 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:49.822307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e04ac1-c020-484e-b003-6bec8071b184 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:49.824487 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e04ac1-c020-484e-b003-6bec8071b184 service glance] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:49.834017 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1198/2422] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:50.776217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0ae26-91dc-4836-b10a-fb7912fe7f86 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:50.777778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-78d0ae26-91dc-4836-b10a-fb7912fe7f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:50.842539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d0ae26-91dc-4836-b10a-fb7912fe7f86 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:50.847203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:50.848094 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:50.848381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:50.848657 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] PATH_INFO: `/v3/users/d6d76d9f999d4328a8517d8bdf35284e` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:50.849844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d76d9f999d4328a8517d8bdf35284e)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:50.851764 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:50.898750 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d76d9f999d4328a8517d8bdf35284e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:50.912254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d76d9f999d4328a8517d8bdf35284e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:50.913002 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d76d9f999d4328a8517d8bdf35284e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:50.921508 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d76d9f999d4328a8517d8bdf35284e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:50.928219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d76d9f999d4328a8517d8bdf35284e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:50.934680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1225/2423] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:50 2022] DELETE /identity/v3/users/d6d76d9f999d4328a8517d8bdf35284e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:50.939820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8b8f7-90c6-4657-ba22-774dd0725795 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:50.940395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8b8f7-90c6-4657-ba22-774dd0725795 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:50.940395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8b8f7-90c6-4657-ba22-774dd0725795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:50.957892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-83f8b8f7-90c6-4657-ba22-774dd0725795 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:50.959071 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-83f8b8f7-90c6-4657-ba22-774dd0725795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:51.019513 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1199/2424] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:51.028931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:51.030308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:51.087663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a055e4d-c383-4f0c-80c9-d3e05d0ac4fc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:51.092231 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce1ebe-729e-4feb-b85a-50a919e7ca35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:51.092951 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce1ebe-729e-4feb-b85a-50a919e7ca35 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:51.093233 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce1ebe-729e-4feb-b85a-50a919e7ca35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:51.093510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce1ebe-729e-4feb-b85a-50a919e7ca35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:51.104247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce1ebe-729e-4feb-b85a-50a919e7ca35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:51.105707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce1ebe-729e-4feb-b85a-50a919e7ca35 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:51.115058 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1226/2425] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:32:51.389163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8b8f7-90c6-4657-ba22-774dd0725795 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:51.390754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-83f8b8f7-90c6-4657-ba22-774dd0725795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:51.406252 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8b8f7-90c6-4657-ba22-774dd0725795 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:51.411422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d80f46-c6e6-45b1-a964-3fb393750cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:51.412459 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d80f46-c6e6-45b1-a964-3fb393750cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:51.412812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d80f46-c6e6-45b1-a964-3fb393750cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:51.412965 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d80f46-c6e6-45b1-a964-3fb393750cdc admin admin] PATH_INFO: `/v3/projects/7e3398fd31a7491f9db40c9f66f542f0` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:51.414325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d80f46-c6e6-45b1-a964-3fb393750cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e3398fd31a7491f9db40c9f66f542f0)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:51.416723 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d80f46-c6e6-45b1-a964-3fb393750cdc admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:51.466708 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-03d80f46-c6e6-45b1-a964-3fb393750cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e3398fd31a7491f9db40c9f66f542f0', 'request_id': 'req-03d80f46-c6e6-45b1-a964-3fb393750cdc'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:51.471976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-03d80f46-c6e6-45b1-a964-3fb393750cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e3398fd31a7491f9db40c9f66f542f0', 'request_id': 'req-03d80f46-c6e6-45b1-a964-3fb393750cdc'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:51.478040 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-03d80f46-c6e6-45b1-a964-3fb393750cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e3398fd31a7491f9db40c9f66f542f0', 'request_id': 'req-03d80f46-c6e6-45b1-a964-3fb393750cdc'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:51.490836 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-03d80f46-c6e6-45b1-a964-3fb393750cdc admin admin] The token cache is being invalidate because project 7e3398fd31a7491f9db40c9f66f542f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:51.491130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-03d80f46-c6e6-45b1-a964-3fb393750cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:51.491780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-03d80f46-c6e6-45b1-a964-3fb393750cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:51.493464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1200/2426] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:51 2022] DELETE /identity/v3/projects/7e3398fd31a7491f9db40c9f66f542f0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:51.499363 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd760e-80ef-4010-b93e-ee6e56156750 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:51.499649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd760e-80ef-4010-b93e-ee6e56156750 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:51.499925 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd760e-80ef-4010-b93e-ee6e56156750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:51.517910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f4fd760e-80ef-4010-b93e-ee6e56156750 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:51.519027 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f4fd760e-80ef-4010-b93e-ee6e56156750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:51.580039 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1227/2427] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:51.589270 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9fec-d3e6-48d5-9e83-1b43f6be080a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:51.589772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9fec-d3e6-48d5-9e83-1b43f6be080a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:51.590110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9fec-d3e6-48d5-9e83-1b43f6be080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:51.609513 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-fc7d9fec-d3e6-48d5-9e83-1b43f6be080a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:51.610698 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-fc7d9fec-d3e6-48d5-9e83-1b43f6be080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:51.618473 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1201/2428] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:51.623472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd760e-80ef-4010-b93e-ee6e56156750 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:51.633454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd760e-80ef-4010-b93e-ee6e56156750 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:51.638462 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642634f5-973b-4a02-affc-7108956a510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:51.639126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642634f5-973b-4a02-affc-7108956a510d admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:51.639411 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642634f5-973b-4a02-affc-7108956a510d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:51.639716 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642634f5-973b-4a02-affc-7108956a510d admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:51.640482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642634f5-973b-4a02-affc-7108956a510d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:32:51.640794 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642634f5-973b-4a02-affc-7108956a510d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:51.642402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642634f5-973b-4a02-affc-7108956a510d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:51.654166 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1228/2429] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:32:51.658441 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9fec-d3e6-48d5-9e83-1b43f6be080a None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:51.668364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9fec-d3e6-48d5-9e83-1b43f6be080a None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:51.673770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff7b04-297c-4f04-a61a-5b32619e227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:51.674432 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff7b04-297c-4f04-a61a-5b32619e227b admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:51.674716 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff7b04-297c-4f04-a61a-5b32619e227b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:51.674991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff7b04-297c-4f04-a61a-5b32619e227b admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:51.675694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff7b04-297c-4f04-a61a-5b32619e227b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:51.677618 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff7b04-297c-4f04-a61a-5b32619e227b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:51.704527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1202/2430] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:51 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:51.708625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642634f5-973b-4a02-affc-7108956a510d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:51.718684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642634f5-973b-4a02-affc-7108956a510d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:51.775037 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0ded2-f1ea-4b21-bb17-6671e294979a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:51.775613 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0ded2-f1ea-4b21-bb17-6671e294979a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:51.775896 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0ded2-f1ea-4b21-bb17-6671e294979a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:51.776295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0ded2-f1ea-4b21-bb17-6671e294979a admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:51.777043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0ded2-f1ea-4b21-bb17-6671e294979a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:51.779004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0ded2-f1ea-4b21-bb17-6671e294979a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:51.799053 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1229/2431] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:51 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:51.803313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff7b04-297c-4f04-a61a-5b32619e227b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:51.814411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff7b04-297c-4f04-a61a-5b32619e227b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:51.819104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04fcb3-af85-4cd2-80d4-b28b6a9783a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:51.819781 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04fcb3-af85-4cd2-80d4-b28b6a9783a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:51.820093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04fcb3-af85-4cd2-80d4-b28b6a9783a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:51.820370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04fcb3-af85-4cd2-80d4-b28b6a9783a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:51.821106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04fcb3-af85-4cd2-80d4-b28b6a9783a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:51.822688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04fcb3-af85-4cd2-80d4-b28b6a9783a0 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:51.833635 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1203/2432] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:51.837679 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0ded2-f1ea-4b21-bb17-6671e294979a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:51.848064 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0ded2-f1ea-4b21-bb17-6671e294979a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:51.852680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf224a-a898-43b2-a5f9-f7dfb4321018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:51.853328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf224a-a898-43b2-a5f9-f7dfb4321018 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:51.853606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf224a-a898-43b2-a5f9-f7dfb4321018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:51.853878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf224a-a898-43b2-a5f9-f7dfb4321018 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:51.855381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf224a-a898-43b2-a5f9-f7dfb4321018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:51.857178 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf224a-a898-43b2-a5f9-f7dfb4321018 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:51.870964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1230/2433] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:51.872494 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04fcb3-af85-4cd2-80d4-b28b6a9783a0 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:51.882774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04fcb3-af85-4cd2-80d4-b28b6a9783a0 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:51.887779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071c358-f4f8-4cfd-8b37-0b38eeac4cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:51.888699 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071c358-f4f8-4cfd-8b37-0b38eeac4cae admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:51.888981 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071c358-f4f8-4cfd-8b37-0b38eeac4cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:51.889253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071c358-f4f8-4cfd-8b37-0b38eeac4cae admin admin] PATH_INFO: `/v3/projects/a5554cb3efc447979595ed0cee782561/users/162130b8c5ac4c69b83e3542821e99be/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:51.904678 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071c358-f4f8-4cfd-8b37-0b38eeac4cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5554cb3efc447979595ed0cee782561, user_id=162130b8c5ac4c69b83e3542821e99be, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:51.907394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071c358-f4f8-4cfd-8b37-0b38eeac4cae admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:51.922413 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1204/2434] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:51 2022] PUT /identity/v3/projects/a5554cb3efc447979595ed0cee782561/users/162130b8c5ac4c69b83e3542821e99be/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:32:51.933045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32ddc4-5673-4f89-ba79-848c1595aa3c None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:51.933331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32ddc4-5673-4f89-ba79-848c1595aa3c None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:51.933635 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32ddc4-5673-4f89-ba79-848c1595aa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:51.960775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-bc32ddc4-5673-4f89-ba79-848c1595aa3c None None] MFA Rules not processed for user `162130b8c5ac4c69b83e3542821e99be`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:51.961965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bc32ddc4-5673-4f89-ba79-848c1595aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:52.026759 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1231/2435] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:52.037340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071c358-f4f8-4cfd-8b37-0b38eeac4cae admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:52.039236 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1071c358-f4f8-4cfd-8b37-0b38eeac4cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:52.096757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071c358-f4f8-4cfd-8b37-0b38eeac4cae admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:52.100387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b818d72-689b-4105-91be-0c72401e7b4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:52.101027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b818d72-689b-4105-91be-0c72401e7b4d service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:52.101313 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b818d72-689b-4105-91be-0c72401e7b4d service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:52.101592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b818d72-689b-4105-91be-0c72401e7b4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:52.110316 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b818d72-689b-4105-91be-0c72401e7b4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:52.111770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b818d72-689b-4105-91be-0c72401e7b4d service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:52.121713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1205/2436] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:54.638219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32ddc4-5673-4f89-ba79-848c1595aa3c None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:54.698415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32ddc4-5673-4f89-ba79-848c1595aa3c None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:54.703484 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:54.704455 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:54.704803 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:54.705083 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] PATH_INFO: `/v3/users/162130b8c5ac4c69b83e3542821e99be` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:54.706337 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=162130b8c5ac4c69b83e3542821e99be)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:54.708287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:54.753388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162130b8c5ac4c69b83e3542821e99be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:54.765456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162130b8c5ac4c69b83e3542821e99be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:54.766207 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162130b8c5ac4c69b83e3542821e99be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:54.773542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162130b8c5ac4c69b83e3542821e99be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:54.780885 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162130b8c5ac4c69b83e3542821e99be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:54.786946 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1232/2437] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:32:54 2022] DELETE /identity/v3/users/162130b8c5ac4c69b83e3542821e99be => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:32:54.791387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73aaa5-80d6-48fd-908f-471c3f8a31fe None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:54.791849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73aaa5-80d6-48fd-908f-471c3f8a31fe None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:54.791964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73aaa5-80d6-48fd-908f-471c3f8a31fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:54.810509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-1c73aaa5-80d6-48fd-908f-471c3f8a31fe None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:54.812199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1c73aaa5-80d6-48fd-908f-471c3f8a31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:54.871969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1206/2438] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:54.881922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:54.883350 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:54.945810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad5c62-480e-4786-8a43-fd1587baf1b4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:54.949738 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e9b6a-c6c5-42f1-8ad9-7eb301d46a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:54.950315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e9b6a-c6c5-42f1-8ad9-7eb301d46a0d service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:54.950599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e9b6a-c6c5-42f1-8ad9-7eb301d46a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:54.951360 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e9b6a-c6c5-42f1-8ad9-7eb301d46a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:54.959896 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e9b6a-c6c5-42f1-8ad9-7eb301d46a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:54.961375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e9b6a-c6c5-42f1-8ad9-7eb301d46a0d service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:54.971458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1233/2439] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:55.240624 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73aaa5-80d6-48fd-908f-471c3f8a31fe None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:55.242172 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1c73aaa5-80d6-48fd-908f-471c3f8a31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:55.254639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73aaa5-80d6-48fd-908f-471c3f8a31fe None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:55.260567 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd586a-8ff3-4c50-b580-65cebee6cd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:55.261424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd586a-8ff3-4c50-b580-65cebee6cd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:55.261701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd586a-8ff3-4c50-b580-65cebee6cd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:55.262042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd586a-8ff3-4c50-b580-65cebee6cd23 admin admin] PATH_INFO: `/v3/projects/a5554cb3efc447979595ed0cee782561` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:55.263140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd586a-8ff3-4c50-b580-65cebee6cd23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5554cb3efc447979595ed0cee782561)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:55.265798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd586a-8ff3-4c50-b580-65cebee6cd23 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:55.280497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e9b6a-c6c5-42f1-8ad9-7eb301d46a0d service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:55.282432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-919e9b6a-c6c5-42f1-8ad9-7eb301d46a0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:55.319609 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-04fd586a-8ff3-4c50-b580-65cebee6cd23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5554cb3efc447979595ed0cee782561', 'request_id': 'req-04fd586a-8ff3-4c50-b580-65cebee6cd23'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:55.324960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-04fd586a-8ff3-4c50-b580-65cebee6cd23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5554cb3efc447979595ed0cee782561', 'request_id': 'req-04fd586a-8ff3-4c50-b580-65cebee6cd23'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:55.331579 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-04fd586a-8ff3-4c50-b580-65cebee6cd23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5554cb3efc447979595ed0cee782561', 'request_id': 'req-04fd586a-8ff3-4c50-b580-65cebee6cd23'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:55.345705 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-04fd586a-8ff3-4c50-b580-65cebee6cd23 admin admin] The token cache is being invalidate because project a5554cb3efc447979595ed0cee782561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:32:55.346006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-04fd586a-8ff3-4c50-b580-65cebee6cd23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:55.346683 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-04fd586a-8ff3-4c50-b580-65cebee6cd23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:32:55.348260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1207/2440] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:32:55 2022] DELETE /identity/v3/projects/a5554cb3efc447979595ed0cee782561 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:55.353310 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89acdf5-03a8-4118-9be0-d92899c93a3b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:55.353619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89acdf5-03a8-4118-9be0-d92899c93a3b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:55.353903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89acdf5-03a8-4118-9be0-d92899c93a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:55.360061 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e9b6a-c6c5-42f1-8ad9-7eb301d46a0d service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:55.374657 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a89acdf5-03a8-4118-9be0-d92899c93a3b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:55.375868 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a89acdf5-03a8-4118-9be0-d92899c93a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:55.427284 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaa098-e3f5-4687-ac8b-5c9869984a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:55.428011 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaa098-e3f5-4687-ac8b-5c9869984a2e service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:55.428334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaa098-e3f5-4687-ac8b-5c9869984a2e service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:55.428609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaa098-e3f5-4687-ac8b-5c9869984a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:55.430370 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5eaaa098-e3f5-4687-ac8b-5c9869984a2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:55.437604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1208/2441] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:55.445815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bde30-e5d1-430f-85d9-732d01a74a9e None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:55.446197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bde30-e5d1-430f-85d9-732d01a74a9e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:55.446520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bde30-e5d1-430f-85d9-732d01a74a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:55.465188 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-7d4bde30-e5d1-430f-85d9-732d01a74a9e None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:55.468154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-7d4bde30-e5d1-430f-85d9-732d01a74a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:55.475846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1209/2442] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:32:55.480093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bde30-e5d1-430f-85d9-732d01a74a9e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:55.490358 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bde30-e5d1-430f-85d9-732d01a74a9e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:55.494208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaa098-e3f5-4687-ac8b-5c9869984a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:55.495168 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb25a0-9d58-4e8d-a6d2-98442eb76aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:55.495917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb25a0-9d58-4e8d-a6d2-98442eb76aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:55.496069 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaa098-e3f5-4687-ac8b-5c9869984a2e service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:55.496233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb25a0-9d58-4e8d-a6d2-98442eb76aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:55.496509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb25a0-9d58-4e8d-a6d2-98442eb76aa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:55.497230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb25a0-9d58-4e8d-a6d2-98442eb76aa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:32:55.498157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb25a0-9d58-4e8d-a6d2-98442eb76aa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:55.499803 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb25a0-9d58-4e8d-a6d2-98442eb76aa1 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:55.506293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1234/2443] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:32:55.511587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1210/2444] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:32:55.516599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaa098-e3f5-4687-ac8b-5c9869984a2e service nova] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:55.527334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaa098-e3f5-4687-ac8b-5c9869984a2e service nova] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:55.532952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c83c0-3783-43af-9929-aafeb8ffe859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:55.533628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c83c0-3783-43af-9929-aafeb8ffe859 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:55.533911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c83c0-3783-43af-9929-aafeb8ffe859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:55.534190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c83c0-3783-43af-9929-aafeb8ffe859 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:55.535127 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c83c0-3783-43af-9929-aafeb8ffe859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:55.537055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c83c0-3783-43af-9929-aafeb8ffe859 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:55.563432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1235/2445] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:32:55 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:32:55.567611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb25a0-9d58-4e8d-a6d2-98442eb76aa1 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:55.578264 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb25a0-9d58-4e8d-a6d2-98442eb76aa1 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:55.636593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e04b3e-4d37-4cae-aa5f-05ec37b2d89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:55.637678 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e04b3e-4d37-4cae-aa5f-05ec37b2d89d admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:55.637678 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e04b3e-4d37-4cae-aa5f-05ec37b2d89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:55.637879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e04b3e-4d37-4cae-aa5f-05ec37b2d89d admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:55.639105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e04b3e-4d37-4cae-aa5f-05ec37b2d89d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:55.641488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e04b3e-4d37-4cae-aa5f-05ec37b2d89d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:55.663168 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1211/2446] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:32:55 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:32:55.667310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c83c0-3783-43af-9929-aafeb8ffe859 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:55.677633 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c83c0-3783-43af-9929-aafeb8ffe859 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:55.682306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a1bc4-1019-4a9f-9bc7-e245f16c8308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:55.682962 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1bc4-1019-4a9f-9bc7-e245f16c8308 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:55.683253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1bc4-1019-4a9f-9bc7-e245f16c8308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:55.683531 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a1bc4-1019-4a9f-9bc7-e245f16c8308 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:55.684282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a1bc4-1019-4a9f-9bc7-e245f16c8308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:55.686366 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a1bc4-1019-4a9f-9bc7-e245f16c8308 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:55.696914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1236/2447] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:32:55.701642 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e04b3e-4d37-4cae-aa5f-05ec37b2d89d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:55.719695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e04b3e-4d37-4cae-aa5f-05ec37b2d89d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:55.729953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e938a97-f7f2-4570-b4f7-ba2c5c4129d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:55.730648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e938a97-f7f2-4570-b4f7-ba2c5c4129d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:55.730938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e938a97-f7f2-4570-b4f7-ba2c5c4129d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:55.731217 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e938a97-f7f2-4570-b4f7-ba2c5c4129d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:55.731979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e938a97-f7f2-4570-b4f7-ba2c5c4129d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:55.733696 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e938a97-f7f2-4570-b4f7-ba2c5c4129d6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:55.743858 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1212/2448] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:32:55.748125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a1bc4-1019-4a9f-9bc7-e245f16c8308 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:55.758394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a1bc4-1019-4a9f-9bc7-e245f16c8308 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:55.766181 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06484a39-705e-47f8-8794-98442d939a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:55.768717 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06484a39-705e-47f8-8794-98442d939a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:55.769059 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06484a39-705e-47f8-8794-98442d939a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:55.769341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06484a39-705e-47f8-8794-98442d939a17 admin admin] PATH_INFO: `/v3/projects/6cb62de0f3a54de7877da27cb2636d89/users/c7f1ae27ae524f638e945885e0db5698/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:55.788932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06484a39-705e-47f8-8794-98442d939a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb62de0f3a54de7877da27cb2636d89, user_id=c7f1ae27ae524f638e945885e0db5698, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:55.791515 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06484a39-705e-47f8-8794-98442d939a17 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:55.807203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1237/2449] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:32:55 2022] PUT /identity/v3/projects/6cb62de0f3a54de7877da27cb2636d89/users/c7f1ae27ae524f638e945885e0db5698/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:32:55.816711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26488b39-d43c-4276-b340-7ff025ed3fc3 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:55.817257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26488b39-d43c-4276-b340-7ff025ed3fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:55.817592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26488b39-d43c-4276-b340-7ff025ed3fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:55.848366 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-26488b39-d43c-4276-b340-7ff025ed3fc3 None None] MFA Rules not processed for user `c7f1ae27ae524f638e945885e0db5698`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:32:55.849573 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-26488b39-d43c-4276-b340-7ff025ed3fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:55.915128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1213/2450] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:32:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:32:55.925151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06484a39-705e-47f8-8794-98442d939a17 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:32:55.926891 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-06484a39-705e-47f8-8794-98442d939a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:32:55.984364 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06484a39-705e-47f8-8794-98442d939a17 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:32:55.988003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045631f6-4343-48bc-99ee-abe831490403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:32:55.988684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045631f6-4343-48bc-99ee-abe831490403 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:32:55.988968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045631f6-4343-48bc-99ee-abe831490403 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:32:55.989243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045631f6-4343-48bc-99ee-abe831490403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:32:55.997929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045631f6-4343-48bc-99ee-abe831490403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:32:55.999369 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045631f6-4343-48bc-99ee-abe831490403 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:32:56.008068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1238/2451] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:32:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:02.261311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26488b39-d43c-4276-b340-7ff025ed3fc3 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:02.263385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-26488b39-d43c-4276-b340-7ff025ed3fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:02.344980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26488b39-d43c-4276-b340-7ff025ed3fc3 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:02.350891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f65055-dbe2-4ddc-b177-33b9ec2f49cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:02.351583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f65055-dbe2-4ddc-b177-33b9ec2f49cd service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:02.351815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f65055-dbe2-4ddc-b177-33b9ec2f49cd service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:02.352127 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f65055-dbe2-4ddc-b177-33b9ec2f49cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:02.354161 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-39f65055-dbe2-4ddc-b177-33b9ec2f49cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:02.367484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f65055-dbe2-4ddc-b177-33b9ec2f49cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:02.369206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f65055-dbe2-4ddc-b177-33b9ec2f49cd service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:02.380077 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1214/2452] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:08.792738 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd4b20-f8bf-40df-b2b4-71228488489d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:08.793236 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd4b20-f8bf-40df-b2b4-71228488489d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:08.793337 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd4b20-f8bf-40df-b2b4-71228488489d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:08.810428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-23fd4b20-f8bf-40df-b2b4-71228488489d None None] MFA Rules not processed for user `2968933854654df18956bb48d4810159`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:08.811782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-23fd4b20-f8bf-40df-b2b4-71228488489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:08.865844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1239/2453] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:09.164960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f65055-dbe2-4ddc-b177-33b9ec2f49cd service nova] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:09.166359 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-39f65055-dbe2-4ddc-b177-33b9ec2f49cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:09.226001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f65055-dbe2-4ddc-b177-33b9ec2f49cd service nova] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:09.229536 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc3480-d26a-4562-902c-a79ca087e9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:09.230165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc3480-d26a-4562-902c-a79ca087e9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:09.230444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc3480-d26a-4562-902c-a79ca087e9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:09.230714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc3480-d26a-4562-902c-a79ca087e9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:09.232489 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a4fc3480-d26a-4562-902c-a79ca087e9b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:09.242040 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc3480-d26a-4562-902c-a79ca087e9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:09.243449 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc3480-d26a-4562-902c-a79ca087e9b1 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:09.251258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1215/2454] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:09.555973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd4b20-f8bf-40df-b2b4-71228488489d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:09.557480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-23fd4b20-f8bf-40df-b2b4-71228488489d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:09.627222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd4b20-f8bf-40df-b2b4-71228488489d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:09.632325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78d331-5ae2-492d-ab94-f9b368ab0d74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d870fbd90cb4fde9ceafd2b737795eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:09.632963 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78d331-5ae2-492d-ab94-f9b368ab0d74 service placement] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:09.633243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78d331-5ae2-492d-ab94-f9b368ab0d74 service placement] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:09.633516 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78d331-5ae2-492d-ab94-f9b368ab0d74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:09.635269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4e78d331-5ae2-492d-ab94-f9b368ab0d74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:09.646269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78d331-5ae2-492d-ab94-f9b368ab0d74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:09.647812 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78d331-5ae2-492d-ab94-f9b368ab0d74 service placement] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:09.657919 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1240/2455] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:13.666889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc3480-d26a-4562-902c-a79ca087e9b1 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:13.668347 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a4fc3480-d26a-4562-902c-a79ca087e9b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:13.732423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc3480-d26a-4562-902c-a79ca087e9b1 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:13.737245 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:13.738142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:13.738422 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:13.738697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] PATH_INFO: `/v3/users/fd6f310dcdf743cb9e74d792873b355f` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:13.739911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd6f310dcdf743cb9e74d792873b355f)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:13.741895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:13.785909 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd6f310dcdf743cb9e74d792873b355f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:13.796908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd6f310dcdf743cb9e74d792873b355f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:13.803524 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd6f310dcdf743cb9e74d792873b355f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:13.810095 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd6f310dcdf743cb9e74d792873b355f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:13.810722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd6f310dcdf743cb9e74d792873b355f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:13.816543 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1216/2456] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:33:13 2022] DELETE /identity/v3/users/fd6f310dcdf743cb9e74d792873b355f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:13.821029 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe474795-78c9-4c3c-b212-4bc759fa6395 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:13.821518 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe474795-78c9-4c3c-b212-4bc759fa6395 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:13.821612 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe474795-78c9-4c3c-b212-4bc759fa6395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:13.839346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-fe474795-78c9-4c3c-b212-4bc759fa6395 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:13.840567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fe474795-78c9-4c3c-b212-4bc759fa6395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:13.899379 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1241/2457] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:13.909387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:13.911048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:13.966790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fe8e7-42e7-4b22-9c5e-d3f6478c492d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:13.970884 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64220500-ccec-4df3-a37a-18ea44a4bb30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:13.971519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64220500-ccec-4df3-a37a-18ea44a4bb30 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:13.971805 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64220500-ccec-4df3-a37a-18ea44a4bb30 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:13.972115 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64220500-ccec-4df3-a37a-18ea44a4bb30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:13.980950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64220500-ccec-4df3-a37a-18ea44a4bb30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:13.982371 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64220500-ccec-4df3-a37a-18ea44a4bb30 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:13.992047 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1217/2458] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:14.273463 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe474795-78c9-4c3c-b212-4bc759fa6395 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:14.275102 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fe474795-78c9-4c3c-b212-4bc759fa6395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:14.288205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe474795-78c9-4c3c-b212-4bc759fa6395 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:14.293254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688ad30-2ec0-4424-8d61-550bcaf2699d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:14.295532 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688ad30-2ec0-4424-8d61-550bcaf2699d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:14.295532 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688ad30-2ec0-4424-8d61-550bcaf2699d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:14.295767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688ad30-2ec0-4424-8d61-550bcaf2699d admin admin] PATH_INFO: `/v3/projects/5105cd6acae94ba8a4cad44f95976834` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:14.297648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688ad30-2ec0-4424-8d61-550bcaf2699d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5105cd6acae94ba8a4cad44f95976834)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:14.299442 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688ad30-2ec0-4424-8d61-550bcaf2699d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:14.346684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-7688ad30-2ec0-4424-8d61-550bcaf2699d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5105cd6acae94ba8a4cad44f95976834', 'request_id': 'req-7688ad30-2ec0-4424-8d61-550bcaf2699d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:14.351868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-7688ad30-2ec0-4424-8d61-550bcaf2699d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5105cd6acae94ba8a4cad44f95976834', 'request_id': 'req-7688ad30-2ec0-4424-8d61-550bcaf2699d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:14.358096 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-7688ad30-2ec0-4424-8d61-550bcaf2699d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5105cd6acae94ba8a4cad44f95976834', 'request_id': 'req-7688ad30-2ec0-4424-8d61-550bcaf2699d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:14.371678 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-7688ad30-2ec0-4424-8d61-550bcaf2699d admin admin] The token cache is being invalidate because project 5105cd6acae94ba8a4cad44f95976834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:33:14.371964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-7688ad30-2ec0-4424-8d61-550bcaf2699d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:14.372614 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-7688ad30-2ec0-4424-8d61-550bcaf2699d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:14.374201 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1242/2459] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:33:14 2022] DELETE /identity/v3/projects/5105cd6acae94ba8a4cad44f95976834 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:14.379232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb923a-03fb-4d94-a399-884d4a842039 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:14.379650 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb923a-03fb-4d94-a399-884d4a842039 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:14.379926 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb923a-03fb-4d94-a399-884d4a842039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:14.398512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0dcb923a-03fb-4d94-a399-884d4a842039 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:14.399689 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0dcb923a-03fb-4d94-a399-884d4a842039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:14.460311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1218/2460] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:14.467758 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db951869-2f2a-4a42-88c7-73cf12b710b5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:14.468075 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db951869-2f2a-4a42-88c7-73cf12b710b5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:14.468357 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db951869-2f2a-4a42-88c7-73cf12b710b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:14.488484 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-db951869-2f2a-4a42-88c7-73cf12b710b5 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:14.490045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-db951869-2f2a-4a42-88c7-73cf12b710b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:14.499707 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1243/2461] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:33:14.504766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb923a-03fb-4d94-a399-884d4a842039 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:14.514186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb923a-03fb-4d94-a399-884d4a842039 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:14.519709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9b6d2-76d9-403c-a0cb-f17fe9858664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:14.520383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b6d2-76d9-403c-a0cb-f17fe9858664 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:14.520662 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b6d2-76d9-403c-a0cb-f17fe9858664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:14.520948 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9b6d2-76d9-403c-a0cb-f17fe9858664 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:14.521927 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9b6d2-76d9-403c-a0cb-f17fe9858664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:33:14.522476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9b6d2-76d9-403c-a0cb-f17fe9858664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:14.524078 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9b6d2-76d9-403c-a0cb-f17fe9858664 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:14.536319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1219/2462] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:33:14.540459 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db951869-2f2a-4a42-88c7-73cf12b710b5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:14.549805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db951869-2f2a-4a42-88c7-73cf12b710b5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:14.554514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c7428-4485-45e9-b85b-7c41b8bbdabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:14.555148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c7428-4485-45e9-b85b-7c41b8bbdabb admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:14.555426 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c7428-4485-45e9-b85b-7c41b8bbdabb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:14.555696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c7428-4485-45e9-b85b-7c41b8bbdabb admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:14.556532 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c7428-4485-45e9-b85b-7c41b8bbdabb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:14.558429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c7428-4485-45e9-b85b-7c41b8bbdabb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:14.583085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1244/2463] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:33:14 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:33:14.587257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9b6d2-76d9-403c-a0cb-f17fe9858664 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:14.597897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9b6d2-76d9-403c-a0cb-f17fe9858664 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:14.651137 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e10c7d-1902-462e-9721-3dee92148f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:14.651822 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e10c7d-1902-462e-9721-3dee92148f49 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:14.652141 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e10c7d-1902-462e-9721-3dee92148f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:14.652412 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e10c7d-1902-462e-9721-3dee92148f49 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:14.653081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e10c7d-1902-462e-9721-3dee92148f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:14.654977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e10c7d-1902-462e-9721-3dee92148f49 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:14.673865 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1220/2464] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:33:14 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:33:14.677972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c7428-4485-45e9-b85b-7c41b8bbdabb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:14.688618 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c7428-4485-45e9-b85b-7c41b8bbdabb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:14.693441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c74f8e-a285-4cf0-9fd2-0912327436af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:14.694088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c74f8e-a285-4cf0-9fd2-0912327436af admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:14.694365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c74f8e-a285-4cf0-9fd2-0912327436af admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:14.694635 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c74f8e-a285-4cf0-9fd2-0912327436af admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:14.695350 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c74f8e-a285-4cf0-9fd2-0912327436af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:14.696957 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c74f8e-a285-4cf0-9fd2-0912327436af admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:14.707733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1245/2465] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:33:14.711722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e10c7d-1902-462e-9721-3dee92148f49 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:14.721892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e10c7d-1902-462e-9721-3dee92148f49 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:14.726484 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac29d99-4d91-4946-9d1a-a123ef6fe67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:14.727129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac29d99-4d91-4946-9d1a-a123ef6fe67a admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:14.727409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac29d99-4d91-4946-9d1a-a123ef6fe67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:14.727685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac29d99-4d91-4946-9d1a-a123ef6fe67a admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:14.728619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac29d99-4d91-4946-9d1a-a123ef6fe67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:14.730022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac29d99-4d91-4946-9d1a-a123ef6fe67a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:14.739737 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1221/2466] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:33:14.743604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c74f8e-a285-4cf0-9fd2-0912327436af admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:14.754944 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c74f8e-a285-4cf0-9fd2-0912327436af admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:14.759602 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c784a-42a6-40ff-b3df-e85db37478db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:14.760502 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c784a-42a6-40ff-b3df-e85db37478db admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:14.760778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c784a-42a6-40ff-b3df-e85db37478db admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:14.761046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c784a-42a6-40ff-b3df-e85db37478db admin admin] PATH_INFO: `/v3/projects/033858c237e741dd8ccee9c7142a45f9/users/01afee50bf0049dfafea3093f7de1fcb/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:14.775991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c784a-42a6-40ff-b3df-e85db37478db admin admin] RBAC: Authorizing `identity:create_grant(project_id=033858c237e741dd8ccee9c7142a45f9, user_id=01afee50bf0049dfafea3093f7de1fcb, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:14.778651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c784a-42a6-40ff-b3df-e85db37478db admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:14.791753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1246/2467] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:33:14 2022] PUT /identity/v3/projects/033858c237e741dd8ccee9c7142a45f9/users/01afee50bf0049dfafea3093f7de1fcb/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:33:14.802230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3aae4-fcd9-4fe8-ad12-0d5197f000c8 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:14.802520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3aae4-fcd9-4fe8-ad12-0d5197f000c8 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:14.802801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3aae4-fcd9-4fe8-ad12-0d5197f000c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:14.830566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-ddd3aae4-fcd9-4fe8-ad12-0d5197f000c8 None None] MFA Rules not processed for user `01afee50bf0049dfafea3093f7de1fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:14.831767 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ddd3aae4-fcd9-4fe8-ad12-0d5197f000c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:14.893961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1222/2468] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:14.898452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c784a-42a6-40ff-b3df-e85db37478db admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:14.960312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c784a-42a6-40ff-b3df-e85db37478db admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:14.964946 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d7c30-d47e-492b-8394-d7ac378d551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:14.965538 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d7c30-d47e-492b-8394-d7ac378d551f admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:14.965820 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d7c30-d47e-492b-8394-d7ac378d551f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:14.966095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d7c30-d47e-492b-8394-d7ac378d551f admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:14.966769 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d7c30-d47e-492b-8394-d7ac378d551f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:14.968693 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d7c30-d47e-492b-8394-d7ac378d551f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:14.993962 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1247/2469] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:33:14 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:33:14.998025 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3aae4-fcd9-4fe8-ad12-0d5197f000c8 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:15.009268 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3aae4-fcd9-4fe8-ad12-0d5197f000c8 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:15.196331 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a1bf0-7850-4d03-9523-e83be9cbc008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:15.196991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a1bf0-7850-4d03-9523-e83be9cbc008 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:15.197271 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a1bf0-7850-4d03-9523-e83be9cbc008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:15.197546 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a1bf0-7850-4d03-9523-e83be9cbc008 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:15.198233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a1bf0-7850-4d03-9523-e83be9cbc008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:15.200197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a1bf0-7850-4d03-9523-e83be9cbc008 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:15.224052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1223/2470] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:33:14 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:33:15.224211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d7c30-d47e-492b-8394-d7ac378d551f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:15.225005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a1bf0-7850-4d03-9523-e83be9cbc008 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:15.225192 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-480d7c30-d47e-492b-8394-d7ac378d551f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:15.235368 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a1bf0-7850-4d03-9523-e83be9cbc008 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:15.238088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d7c30-d47e-492b-8394-d7ac378d551f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:15.240506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bb441-24fb-4642-a67e-aeba69321d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:15.241149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bb441-24fb-4642-a67e-aeba69321d69 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:15.241424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bb441-24fb-4642-a67e-aeba69321d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:15.241700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bb441-24fb-4642-a67e-aeba69321d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:15.242402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bb441-24fb-4642-a67e-aeba69321d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:15.242590 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dcdce-09d5-4e57-978f-ffdd6d4212ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:15.243446 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dcdce-09d5-4e57-978f-ffdd6d4212ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:15.243723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dcdce-09d5-4e57-978f-ffdd6d4212ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:15.243963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bb441-24fb-4642-a67e-aeba69321d69 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:15.244099 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dcdce-09d5-4e57-978f-ffdd6d4212ef admin admin] PATH_INFO: `/v3/users/c7f1ae27ae524f638e945885e0db5698` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:15.245195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dcdce-09d5-4e57-978f-ffdd6d4212ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f1ae27ae524f638e945885e0db5698)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:15.247097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dcdce-09d5-4e57-978f-ffdd6d4212ef admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:15.254759 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1224/2471] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:33:15.258640 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bb441-24fb-4642-a67e-aeba69321d69 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:15.268908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bb441-24fb-4642-a67e-aeba69321d69 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:15.273815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e661a-f80b-4354-a057-20706c1cc5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:15.274734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e661a-f80b-4354-a057-20706c1cc5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:15.275015 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e661a-f80b-4354-a057-20706c1cc5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:15.275290 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e661a-f80b-4354-a057-20706c1cc5ba admin admin] PATH_INFO: `/v3/projects/fdc8c28d3491458a8cd9c34b3c998de9/users/edaf45525bdf4aa5baf6c4729536c91c/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:15.290347 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e661a-f80b-4354-a057-20706c1cc5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc8c28d3491458a8cd9c34b3c998de9, user_id=edaf45525bdf4aa5baf6c4729536c91c, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:15.293007 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e661a-f80b-4354-a057-20706c1cc5ba admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:15.294628 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ac6dcdce-09d5-4e57-978f-ffdd6d4212ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f1ae27ae524f638e945885e0db5698'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:15.308902 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1225/2472] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:33:15 2022] PUT /identity/v3/projects/fdc8c28d3491458a8cd9c34b3c998de9/users/edaf45525bdf4aa5baf6c4729536c91c/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:33:15.309085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ac6dcdce-09d5-4e57-978f-ffdd6d4212ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f1ae27ae524f638e945885e0db5698'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:15.309085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ac6dcdce-09d5-4e57-978f-ffdd6d4212ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f1ae27ae524f638e945885e0db5698'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:15.309861 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e661a-f80b-4354-a057-20706c1cc5ba admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:15.317340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ac6dcdce-09d5-4e57-978f-ffdd6d4212ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f1ae27ae524f638e945885e0db5698'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:15.325821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-ac6dcdce-09d5-4e57-978f-ffdd6d4212ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f1ae27ae524f638e945885e0db5698'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:15.335256 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1248/2473] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:33:15 2022] DELETE /identity/v3/users/c7f1ae27ae524f638e945885e0db5698 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:15.337097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415e52-a0f4-4f99-960a-ef78039da128 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:15.337258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415e52-a0f4-4f99-960a-ef78039da128 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:15.337444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b415e52-a0f4-4f99-960a-ef78039da128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:15.355562 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1b415e52-a0f4-4f99-960a-ef78039da128 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:15.356810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1b415e52-a0f4-4f99-960a-ef78039da128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:15.386199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e661a-f80b-4354-a057-20706c1cc5ba admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:15.435626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1249/2474] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:15.443986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b415e52-a0f4-4f99-960a-ef78039da128 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:15.446018 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1b415e52-a0f4-4f99-960a-ef78039da128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:15.454051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de14a9b-371a-4a90-8620-add3a88bfcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:15.454874 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de14a9b-371a-4a90-8620-add3a88bfcaf admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:15.455160 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de14a9b-371a-4a90-8620-add3a88bfcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:15.455438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de14a9b-371a-4a90-8620-add3a88bfcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:15.456193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de14a9b-371a-4a90-8620-add3a88bfcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:15.457793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de14a9b-371a-4a90-8620-add3a88bfcaf admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:15.471991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1226/2475] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:33:15.476256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de14a9b-371a-4a90-8620-add3a88bfcaf admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:15.478703 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1de14a9b-371a-4a90-8620-add3a88bfcaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:15.495493 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de14a9b-371a-4a90-8620-add3a88bfcaf admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:15.500840 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5da999-712b-47ef-9238-43edc7d20a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:15.501735 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5da999-712b-47ef-9238-43edc7d20a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:15.502012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5da999-712b-47ef-9238-43edc7d20a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:15.502282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5da999-712b-47ef-9238-43edc7d20a92 admin admin] PATH_INFO: `/v3/projects/fdc8c28d3491458a8cd9c34b3c998de9/users/edaf45525bdf4aa5baf6c4729536c91c/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:15.504319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5da999-712b-47ef-9238-43edc7d20a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc8c28d3491458a8cd9c34b3c998de9, user_id=edaf45525bdf4aa5baf6c4729536c91c, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:15.507010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5da999-712b-47ef-9238-43edc7d20a92 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:15.515532 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b415e52-a0f4-4f99-960a-ef78039da128 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:15.518697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1227/2476] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:33:15 2022] PUT /identity/v3/projects/fdc8c28d3491458a8cd9c34b3c998de9/users/edaf45525bdf4aa5baf6c4729536c91c/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:33:15.529899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271d1c2-bb9c-49e9-bf83-059db905c706 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:15.530209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271d1c2-bb9c-49e9-bf83-059db905c706 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:15.530450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271d1c2-bb9c-49e9-bf83-059db905c706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:15.562028 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a271d1c2-bb9c-49e9-bf83-059db905c706 None None] MFA Rules not processed for user `edaf45525bdf4aa5baf6c4729536c91c`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:15.563409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a271d1c2-bb9c-49e9-bf83-059db905c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:15.585530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be59b49-85db-467e-a6ad-bae6d382298f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:15.586627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be59b49-85db-467e-a6ad-bae6d382298f service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:15.587250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be59b49-85db-467e-a6ad-bae6d382298f service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:15.587831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be59b49-85db-467e-a6ad-bae6d382298f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:15.670466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1228/2477] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:33:15.677493 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be59b49-85db-467e-a6ad-bae6d382298f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:15.679188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be59b49-85db-467e-a6ad-bae6d382298f service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:15.680229 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271d1c2-bb9c-49e9-bf83-059db905c706 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:15.683081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a271d1c2-bb9c-49e9-bf83-059db905c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:15.694566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1250/2478] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:33:15.748879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271d1c2-bb9c-49e9-bf83-059db905c706 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:15.753984 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c57e7b-5d4e-40b7-84a1-0d36523f76af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:15.754638 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c57e7b-5d4e-40b7-84a1-0d36523f76af service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:15.754992 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c57e7b-5d4e-40b7-84a1-0d36523f76af service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:15.755171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c57e7b-5d4e-40b7-84a1-0d36523f76af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:15.757526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e5c57e7b-5d4e-40b7-84a1-0d36523f76af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:15.850519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c57e7b-5d4e-40b7-84a1-0d36523f76af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:15.853090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c57e7b-5d4e-40b7-84a1-0d36523f76af service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:15.864788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1229/2479] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:33:16.015565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be59b49-85db-467e-a6ad-bae6d382298f service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:16.019190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5be59b49-85db-467e-a6ad-bae6d382298f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:16.044943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c57e7b-5d4e-40b7-84a1-0d36523f76af service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:16.046865 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e5c57e7b-5d4e-40b7-84a1-0d36523f76af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:16.064436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c57e7b-5d4e-40b7-84a1-0d36523f76af service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:16.070317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:16.071274 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:16.071559 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:16.071948 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] PATH_INFO: `/v3/projects/6cb62de0f3a54de7877da27cb2636d89` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:16.073288 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb62de0f3a54de7877da27cb2636d89)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:16.075419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:16.177162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb62de0f3a54de7877da27cb2636d89', 'request_id': 'req-e92a0c25-f355-45af-ae48-46ef52ca6d4f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:16.197771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb62de0f3a54de7877da27cb2636d89', 'request_id': 'req-e92a0c25-f355-45af-ae48-46ef52ca6d4f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:16.210773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb62de0f3a54de7877da27cb2636d89', 'request_id': 'req-e92a0c25-f355-45af-ae48-46ef52ca6d4f'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:16.216759 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be59b49-85db-467e-a6ad-bae6d382298f service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:16.238248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] The token cache is being invalidate because project 6cb62de0f3a54de7877da27cb2636d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:33:16.238584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:16.239244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:16.244750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1230/2480] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:33:16 2022] DELETE /identity/v3/projects/6cb62de0f3a54de7877da27cb2636d89 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:33:16.423588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee1eab-d88d-40d5-9661-5940b56b2aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:16.425363 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee1eab-d88d-40d5-9661-5940b56b2aef service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:16.427647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee1eab-d88d-40d5-9661-5940b56b2aef service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:16.430148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee1eab-d88d-40d5-9661-5940b56b2aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:16.439797 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-25ee1eab-d88d-40d5-9661-5940b56b2aef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:16.486259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee1eab-d88d-40d5-9661-5940b56b2aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:16.487976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee1eab-d88d-40d5-9661-5940b56b2aef service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:16.516488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1251/2481] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:18.098009 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:18.099439 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:18.119903 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a0c25-f355-45af-ae48-46ef52ca6d4f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:18.126598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98583631-c11d-4fb2-90eb-fc37dc5a884d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:18.127258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98583631-c11d-4fb2-90eb-fc37dc5a884d service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:18.127676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98583631-c11d-4fb2-90eb-fc37dc5a884d service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:18.127958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98583631-c11d-4fb2-90eb-fc37dc5a884d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:18.130354 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-98583631-c11d-4fb2-90eb-fc37dc5a884d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:18.144311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98583631-c11d-4fb2-90eb-fc37dc5a884d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:18.146200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98583631-c11d-4fb2-90eb-fc37dc5a884d service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:18.170976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1231/2482] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:18.731276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee1eab-d88d-40d5-9661-5940b56b2aef service nova] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:18.739785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-25ee1eab-d88d-40d5-9661-5940b56b2aef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:18.818103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee1eab-d88d-40d5-9661-5940b56b2aef service nova] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:18.823003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:18.823967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:18.824390 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:18.824674 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] PATH_INFO: `/v3/users/01afee50bf0049dfafea3093f7de1fcb` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:18.825899 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01afee50bf0049dfafea3093f7de1fcb)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:18.827831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:18.914456 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01afee50bf0049dfafea3093f7de1fcb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:18.928418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01afee50bf0049dfafea3093f7de1fcb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:18.929153 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01afee50bf0049dfafea3093f7de1fcb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:18.937541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01afee50bf0049dfafea3093f7de1fcb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:18.949839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01afee50bf0049dfafea3093f7de1fcb'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:18.961773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1252/2483] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:33:18 2022] DELETE /identity/v3/users/01afee50bf0049dfafea3093f7de1fcb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:18.970754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c36fa9-413a-4494-aedc-06c89cc97aa5 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:18.971259 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c36fa9-413a-4494-aedc-06c89cc97aa5 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:18.972036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c36fa9-413a-4494-aedc-06c89cc97aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:18.993530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a2c36fa9-413a-4494-aedc-06c89cc97aa5 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:18.995269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a2c36fa9-413a-4494-aedc-06c89cc97aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:19.068444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1232/2484] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:19.078063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:19.080400 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:19.138860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088f4b8-bfad-49e8-870a-8fc4ca6e75e3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:19.144756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa971dcb-db3e-4821-9cf8-1895d5b03ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:19.145903 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa971dcb-db3e-4821-9cf8-1895d5b03ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:19.145903 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa971dcb-db3e-4821-9cf8-1895d5b03ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:19.146113 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa971dcb-db3e-4821-9cf8-1895d5b03ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:19.155689 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa971dcb-db3e-4821-9cf8-1895d5b03ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:19.157825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa971dcb-db3e-4821-9cf8-1895d5b03ae4 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:19.167910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1253/2485] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:19.519052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c36fa9-413a-4494-aedc-06c89cc97aa5 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:19.520605 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a2c36fa9-413a-4494-aedc-06c89cc97aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:19.535997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c36fa9-413a-4494-aedc-06c89cc97aa5 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:19.541430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:19.542303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:19.542603 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:19.542876 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] PATH_INFO: `/v3/projects/033858c237e741dd8ccee9c7142a45f9` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:19.544099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=033858c237e741dd8ccee9c7142a45f9)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:19.546022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:19.596351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033858c237e741dd8ccee9c7142a45f9', 'request_id': 'req-016775cc-16ab-4133-9b0c-e1b3a2792f15'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:19.602102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033858c237e741dd8ccee9c7142a45f9', 'request_id': 'req-016775cc-16ab-4133-9b0c-e1b3a2792f15'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:19.608506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033858c237e741dd8ccee9c7142a45f9', 'request_id': 'req-016775cc-16ab-4133-9b0c-e1b3a2792f15'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:19.621410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] The token cache is being invalidate because project 033858c237e741dd8ccee9c7142a45f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:33:19.621852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:19.622543 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:19.624161 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1233/2486] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:33:19 2022] DELETE /identity/v3/projects/033858c237e741dd8ccee9c7142a45f9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:19.628292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa971dcb-db3e-4821-9cf8-1895d5b03ae4 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:19.637816 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa971dcb-db3e-4821-9cf8-1895d5b03ae4 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:19.694952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb8d90-9bf1-40bb-8389-5209cd5ed95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:19.695825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb8d90-9bf1-40bb-8389-5209cd5ed95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:19.696137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb8d90-9bf1-40bb-8389-5209cd5ed95b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:19.696425 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb8d90-9bf1-40bb-8389-5209cd5ed95b admin admin] PATH_INFO: `/v3/users/edaf45525bdf4aa5baf6c4729536c91c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:19.697616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb8d90-9bf1-40bb-8389-5209cd5ed95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=edaf45525bdf4aa5baf6c4729536c91c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:19.699572 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bb8d90-9bf1-40bb-8389-5209cd5ed95b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:19.745192 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-16bb8d90-9bf1-40bb-8389-5209cd5ed95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edaf45525bdf4aa5baf6c4729536c91c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:19.760039 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-16bb8d90-9bf1-40bb-8389-5209cd5ed95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edaf45525bdf4aa5baf6c4729536c91c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:19.760748 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-16bb8d90-9bf1-40bb-8389-5209cd5ed95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edaf45525bdf4aa5baf6c4729536c91c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:19.769496 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-16bb8d90-9bf1-40bb-8389-5209cd5ed95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edaf45525bdf4aa5baf6c4729536c91c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:19.776914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-16bb8d90-9bf1-40bb-8389-5209cd5ed95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edaf45525bdf4aa5baf6c4729536c91c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:19.783842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1254/2487] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:33:19 2022] DELETE /identity/v3/users/edaf45525bdf4aa5baf6c4729536c91c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:33:20.052154 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:20.053632 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:20.071818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016775cc-16ab-4133-9b0c-e1b3a2792f15 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:20.129697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a3c78-5034-47d3-ae37-581188ff05e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:20.130550 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a3c78-5034-47d3-ae37-581188ff05e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:20.130830 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a3c78-5034-47d3-ae37-581188ff05e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:20.131106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a3c78-5034-47d3-ae37-581188ff05e2 admin admin] PATH_INFO: `/v3/projects/fdc8c28d3491458a8cd9c34b3c998de9` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:20.132318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a3c78-5034-47d3-ae37-581188ff05e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc8c28d3491458a8cd9c34b3c998de9)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:20.134251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a3c78-5034-47d3-ae37-581188ff05e2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:20.180179 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-db5a3c78-5034-47d3-ae37-581188ff05e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc8c28d3491458a8cd9c34b3c998de9', 'request_id': 'req-db5a3c78-5034-47d3-ae37-581188ff05e2'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:20.185802 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-db5a3c78-5034-47d3-ae37-581188ff05e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc8c28d3491458a8cd9c34b3c998de9', 'request_id': 'req-db5a3c78-5034-47d3-ae37-581188ff05e2'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:20.193408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-db5a3c78-5034-47d3-ae37-581188ff05e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc8c28d3491458a8cd9c34b3c998de9', 'request_id': 'req-db5a3c78-5034-47d3-ae37-581188ff05e2'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:20.207734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-db5a3c78-5034-47d3-ae37-581188ff05e2 admin admin] The token cache is being invalidate because project fdc8c28d3491458a8cd9c34b3c998de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:33:20.208011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-db5a3c78-5034-47d3-ae37-581188ff05e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:20.208694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-db5a3c78-5034-47d3-ae37-581188ff05e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:20.210303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1234/2488] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:33:20 2022] DELETE /identity/v3/projects/fdc8c28d3491458a8cd9c34b3c998de9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:20.215160 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e47563-d35d-4b4e-bb8a-e2d2db3bb3c8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:20.218422 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e47563-d35d-4b4e-bb8a-e2d2db3bb3c8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:20.218721 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e47563-d35d-4b4e-bb8a-e2d2db3bb3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:20.237841 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-22e47563-d35d-4b4e-bb8a-e2d2db3bb3c8 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:20.239167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-22e47563-d35d-4b4e-bb8a-e2d2db3bb3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:20.298860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1255/2489] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:20.306489 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a843aa-1510-4702-bb04-49176df4452b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:20.306772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a843aa-1510-4702-bb04-49176df4452b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:20.307049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a843aa-1510-4702-bb04-49176df4452b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:20.326268 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-80a843aa-1510-4702-bb04-49176df4452b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:20.327466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-80a843aa-1510-4702-bb04-49176df4452b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:20.336062 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1235/2490] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:20.340249 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e47563-d35d-4b4e-bb8a-e2d2db3bb3c8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:20.350555 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e47563-d35d-4b4e-bb8a-e2d2db3bb3c8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:20.355176 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1692b7-34cf-4e33-9023-3b6f04ad76af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:20.355827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1692b7-34cf-4e33-9023-3b6f04ad76af admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:20.356139 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1692b7-34cf-4e33-9023-3b6f04ad76af admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:20.356418 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1692b7-34cf-4e33-9023-3b6f04ad76af admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:20.357147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1692b7-34cf-4e33-9023-3b6f04ad76af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:33:20.357451 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1692b7-34cf-4e33-9023-3b6f04ad76af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:20.359036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1692b7-34cf-4e33-9023-3b6f04ad76af admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:20.371569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1256/2491] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:33:20.376538 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a843aa-1510-4702-bb04-49176df4452b None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:20.385676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a843aa-1510-4702-bb04-49176df4452b None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:20.390299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da494833-3fc5-4668-9d2b-7519de8ccd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:20.391670 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494833-3fc5-4668-9d2b-7519de8ccd42 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:20.392116 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494833-3fc5-4668-9d2b-7519de8ccd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:20.392365 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da494833-3fc5-4668-9d2b-7519de8ccd42 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:20.393054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494833-3fc5-4668-9d2b-7519de8ccd42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:20.394928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da494833-3fc5-4668-9d2b-7519de8ccd42 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:20.420493 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1236/2492] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:33:20 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:33:20.424831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1692b7-34cf-4e33-9023-3b6f04ad76af admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:20.434886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1692b7-34cf-4e33-9023-3b6f04ad76af admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:20.493939 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74958e-d486-40e8-b255-865ab6891adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:20.494685 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74958e-d486-40e8-b255-865ab6891adf admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:20.494964 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74958e-d486-40e8-b255-865ab6891adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:20.495236 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74958e-d486-40e8-b255-865ab6891adf admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:20.495930 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74958e-d486-40e8-b255-865ab6891adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:20.497854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74958e-d486-40e8-b255-865ab6891adf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:20.518358 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1257/2493] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:33:20 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:33:20.523001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da494833-3fc5-4668-9d2b-7519de8ccd42 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:20.542139 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da494833-3fc5-4668-9d2b-7519de8ccd42 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:20.557297 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d9e6f-acd4-4b9f-82b7-eb6f742ff6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:20.558020 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d9e6f-acd4-4b9f-82b7-eb6f742ff6ff admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:20.558308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d9e6f-acd4-4b9f-82b7-eb6f742ff6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:20.558590 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d9e6f-acd4-4b9f-82b7-eb6f742ff6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:20.560114 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d9e6f-acd4-4b9f-82b7-eb6f742ff6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:20.561764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d9e6f-acd4-4b9f-82b7-eb6f742ff6ff admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:20.572761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1237/2494] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:33:20.576792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74958e-d486-40e8-b255-865ab6891adf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:20.588654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74958e-d486-40e8-b255-865ab6891adf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:20.593622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc18a29-85ec-432e-af6e-c2c9200986a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:20.595141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc18a29-85ec-432e-af6e-c2c9200986a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:20.595425 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc18a29-85ec-432e-af6e-c2c9200986a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:20.595835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc18a29-85ec-432e-af6e-c2c9200986a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:20.596698 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc18a29-85ec-432e-af6e-c2c9200986a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:20.598288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc18a29-85ec-432e-af6e-c2c9200986a1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:20.608753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1258/2495] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:33:20.613707 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d9e6f-acd4-4b9f-82b7-eb6f742ff6ff admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:20.624627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d9e6f-acd4-4b9f-82b7-eb6f742ff6ff admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:20.630504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc04800-e163-41cc-8091-b65acbbf8916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:20.631482 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc04800-e163-41cc-8091-b65acbbf8916 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:20.631828 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc04800-e163-41cc-8091-b65acbbf8916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:20.632207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc04800-e163-41cc-8091-b65acbbf8916 admin admin] PATH_INFO: `/v3/projects/022225c0ecac402997804da54e283a23/users/8f08b759ac3f47a7b38e21d668ec6d6e/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:20.647408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc04800-e163-41cc-8091-b65acbbf8916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=022225c0ecac402997804da54e283a23, user_id=8f08b759ac3f47a7b38e21d668ec6d6e, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:20.650060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc04800-e163-41cc-8091-b65acbbf8916 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:20.664746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1238/2496] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:33:20 2022] PUT /identity/v3/projects/022225c0ecac402997804da54e283a23/users/8f08b759ac3f47a7b38e21d668ec6d6e/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:20.675609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f646a4-9e36-4942-b2d8-bead9b7afcbf None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:20.675909 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f646a4-9e36-4942-b2d8-bead9b7afcbf None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:20.676221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f646a4-9e36-4942-b2d8-bead9b7afcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:20.704052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-29f646a4-9e36-4942-b2d8-bead9b7afcbf None None] MFA Rules not processed for user `8f08b759ac3f47a7b38e21d668ec6d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:20.705049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-29f646a4-9e36-4942-b2d8-bead9b7afcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:20.776458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1259/2497] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:20.780447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc04800-e163-41cc-8091-b65acbbf8916 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:20.846381 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc04800-e163-41cc-8091-b65acbbf8916 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:20.853935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f55f0-5aa7-40b3-ae2b-33693bb40b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:20.854603 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f55f0-5aa7-40b3-ae2b-33693bb40b44 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:20.854885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f55f0-5aa7-40b3-ae2b-33693bb40b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:20.855165 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f55f0-5aa7-40b3-ae2b-33693bb40b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:20.855850 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f55f0-5aa7-40b3-ae2b-33693bb40b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:20.857783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f55f0-5aa7-40b3-ae2b-33693bb40b44 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:20.885985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1239/2498] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:33:20 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:33:20.890209 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f646a4-9e36-4942-b2d8-bead9b7afcbf None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:20.902750 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f646a4-9e36-4942-b2d8-bead9b7afcbf None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:20.961732 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391d6e3-c9e0-45ae-802f-8ef1d6575f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:20.962404 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391d6e3-c9e0-45ae-802f-8ef1d6575f5f admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:20.962697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391d6e3-c9e0-45ae-802f-8ef1d6575f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:20.962975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391d6e3-c9e0-45ae-802f-8ef1d6575f5f admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:20.963660 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391d6e3-c9e0-45ae-802f-8ef1d6575f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:20.965622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391d6e3-c9e0-45ae-802f-8ef1d6575f5f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:20.990892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1260/2499] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:33:20 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:33:20.992299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f55f0-5aa7-40b3-ae2b-33693bb40b44 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:21.003447 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f55f0-5aa7-40b3-ae2b-33693bb40b44 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:21.008174 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a342d-2fd7-43aa-bb85-471d766d8d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:21.008838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a342d-2fd7-43aa-bb85-471d766d8d6c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:21.009120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a342d-2fd7-43aa-bb85-471d766d8d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:21.009392 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a342d-2fd7-43aa-bb85-471d766d8d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:21.010204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a342d-2fd7-43aa-bb85-471d766d8d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:21.011805 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a342d-2fd7-43aa-bb85-471d766d8d6c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:21.023361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1240/2500] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:33:21.027402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391d6e3-c9e0-45ae-802f-8ef1d6575f5f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:21.038602 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391d6e3-c9e0-45ae-802f-8ef1d6575f5f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:21.043671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9c771-0db7-426d-a2aa-6bc0116cc002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:21.044360 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9c771-0db7-426d-a2aa-6bc0116cc002 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:21.044644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9c771-0db7-426d-a2aa-6bc0116cc002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:21.044920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9c771-0db7-426d-a2aa-6bc0116cc002 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:21.045639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9c771-0db7-426d-a2aa-6bc0116cc002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:21.048065 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9c771-0db7-426d-a2aa-6bc0116cc002 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:21.058317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1261/2501] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:33:21.062294 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a342d-2fd7-43aa-bb85-471d766d8d6c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:21.072816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a342d-2fd7-43aa-bb85-471d766d8d6c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:21.077424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb586a8-e433-43fa-a220-a61ae957a946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:21.078528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb586a8-e433-43fa-a220-a61ae957a946 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:21.078811 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb586a8-e433-43fa-a220-a61ae957a946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:21.079083 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb586a8-e433-43fa-a220-a61ae957a946 admin admin] PATH_INFO: `/v3/projects/4d82b405891d4481bce5660793434e2e/users/cb34d16e47494ff7876fb3de41f5331f/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:21.093007 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb586a8-e433-43fa-a220-a61ae957a946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d82b405891d4481bce5660793434e2e, user_id=cb34d16e47494ff7876fb3de41f5331f, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:21.096140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb586a8-e433-43fa-a220-a61ae957a946 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:21.110570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1241/2502] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:33:21 2022] PUT /identity/v3/projects/4d82b405891d4481bce5660793434e2e/users/cb34d16e47494ff7876fb3de41f5331f/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:21.122847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc1360-311f-4955-a915-22be7d2fa10b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:21.123220 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc1360-311f-4955-a915-22be7d2fa10b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:21.123556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc1360-311f-4955-a915-22be7d2fa10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:21.151828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-55bc1360-311f-4955-a915-22be7d2fa10b None None] MFA Rules not processed for user `cb34d16e47494ff7876fb3de41f5331f`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:21.153081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-55bc1360-311f-4955-a915-22be7d2fa10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:21.218393 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1262/2503] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:21.223460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb586a8-e433-43fa-a220-a61ae957a946 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:21.284713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb586a8-e433-43fa-a220-a61ae957a946 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:21.289608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a4781-ab59-485d-b5b7-50df7539c152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:21.290273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a4781-ab59-485d-b5b7-50df7539c152 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:21.290673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a4781-ab59-485d-b5b7-50df7539c152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:21.290956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a4781-ab59-485d-b5b7-50df7539c152 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:21.291653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a4781-ab59-485d-b5b7-50df7539c152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:21.293687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a4781-ab59-485d-b5b7-50df7539c152 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:21.321221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1242/2504] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:33:21 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:33:21.324973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc1360-311f-4955-a915-22be7d2fa10b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:21.335681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc1360-311f-4955-a915-22be7d2fa10b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:21.395607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ee2d-04ef-4c87-8073-e9dbe95bc5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:21.396331 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ee2d-04ef-4c87-8073-e9dbe95bc5cf admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:21.396615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ee2d-04ef-4c87-8073-e9dbe95bc5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:21.396898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6ee2d-04ef-4c87-8073-e9dbe95bc5cf admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:21.397601 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6ee2d-04ef-4c87-8073-e9dbe95bc5cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:21.399534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6ee2d-04ef-4c87-8073-e9dbe95bc5cf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:21.427426 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1263/2505] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:33:21 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:33:21.429163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a4781-ab59-485d-b5b7-50df7539c152 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:21.440698 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a4781-ab59-485d-b5b7-50df7539c152 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:21.446026 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56185ebd-4403-4cbb-894f-d20596cc09ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:21.447166 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56185ebd-4403-4cbb-894f-d20596cc09ce admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:21.447771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56185ebd-4403-4cbb-894f-d20596cc09ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:21.447917 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56185ebd-4403-4cbb-894f-d20596cc09ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:21.449120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56185ebd-4403-4cbb-894f-d20596cc09ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:21.451398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56185ebd-4403-4cbb-894f-d20596cc09ce admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:21.463959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1243/2506] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:33:21.468291 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ee2d-04ef-4c87-8073-e9dbe95bc5cf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:21.479817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6ee2d-04ef-4c87-8073-e9dbe95bc5cf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:21.485175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fa9c-a1da-48f0-a7e7-a85b3929dd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:21.486182 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fa9c-a1da-48f0-a7e7-a85b3929dd67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:21.486471 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fa9c-a1da-48f0-a7e7-a85b3929dd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:21.486745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fa9c-a1da-48f0-a7e7-a85b3929dd67 admin admin] PATH_INFO: `/v3/projects/4f1b52fc36c14232a673450ce04c3cd2/users/51a07c44f3ed4446b9f0191e95215844/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:21.503385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70fa9c-a1da-48f0-a7e7-a85b3929dd67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1b52fc36c14232a673450ce04c3cd2, user_id=51a07c44f3ed4446b9f0191e95215844, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:21.506117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70fa9c-a1da-48f0-a7e7-a85b3929dd67 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:21.520291 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1264/2507] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:33:21 2022] PUT /identity/v3/projects/4f1b52fc36c14232a673450ce04c3cd2/users/51a07c44f3ed4446b9f0191e95215844/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:33:21.524388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56185ebd-4403-4cbb-894f-d20596cc09ce admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:21.535986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56185ebd-4403-4cbb-894f-d20596cc09ce admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:21.593232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f425a-bd2c-4435-8526-69f2eba1af83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:21.594655 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f425a-bd2c-4435-8526-69f2eba1af83 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:21.595143 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f425a-bd2c-4435-8526-69f2eba1af83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:21.595436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f425a-bd2c-4435-8526-69f2eba1af83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:21.596294 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f425a-bd2c-4435-8526-69f2eba1af83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:21.597899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f425a-bd2c-4435-8526-69f2eba1af83 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:21.612207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1244/2508] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:33:21.613411 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fa9c-a1da-48f0-a7e7-a85b3929dd67 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:21.623788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fa9c-a1da-48f0-a7e7-a85b3929dd67 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:21.629133 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd672f4b-cdd3-48eb-95bb-d6b0cc34a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:21.630019 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd672f4b-cdd3-48eb-95bb-d6b0cc34a282 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:21.630307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd672f4b-cdd3-48eb-95bb-d6b0cc34a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:21.630583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd672f4b-cdd3-48eb-95bb-d6b0cc34a282 admin admin] PATH_INFO: `/v3/projects/4f1b52fc36c14232a673450ce04c3cd2/users/51a07c44f3ed4446b9f0191e95215844/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:21.632590 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd672f4b-cdd3-48eb-95bb-d6b0cc34a282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1b52fc36c14232a673450ce04c3cd2, user_id=51a07c44f3ed4446b9f0191e95215844, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:21.637090 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd672f4b-cdd3-48eb-95bb-d6b0cc34a282 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:21.646543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1265/2509] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:33:21 2022] PUT /identity/v3/projects/4f1b52fc36c14232a673450ce04c3cd2/users/51a07c44f3ed4446b9f0191e95215844/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:33:21.656614 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a43be-a267-4dfd-af10-09ca80d6e90e None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:21.656906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a43be-a267-4dfd-af10-09ca80d6e90e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:21.657189 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a43be-a267-4dfd-af10-09ca80d6e90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:21.684325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-849a43be-a267-4dfd-af10-09ca80d6e90e None None] MFA Rules not processed for user `51a07c44f3ed4446b9f0191e95215844`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:21.685526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-849a43be-a267-4dfd-af10-09ca80d6e90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:21.754252 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1245/2510] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:21.764111 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd672f4b-cdd3-48eb-95bb-d6b0cc34a282 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:21.766556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fd672f4b-cdd3-48eb-95bb-d6b0cc34a282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:21.822215 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd672f4b-cdd3-48eb-95bb-d6b0cc34a282 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:21.826041 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8d266-49a6-4fec-9a28-7cea4472bdf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:21.826766 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8d266-49a6-4fec-9a28-7cea4472bdf5 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:21.826948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8d266-49a6-4fec-9a28-7cea4472bdf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:21.827218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8d266-49a6-4fec-9a28-7cea4472bdf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:21.884943 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8d266-49a6-4fec-9a28-7cea4472bdf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:21.886385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8d266-49a6-4fec-9a28-7cea4472bdf5 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:21.895381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1266/2511] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:23.502359 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a43be-a267-4dfd-af10-09ca80d6e90e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:23.503789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-849a43be-a267-4dfd-af10-09ca80d6e90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:23.515502 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a43be-a267-4dfd-af10-09ca80d6e90e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:23.519760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094f8d5-7dfd-45ff-b943-5c10cb25269f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:23.520437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094f8d5-7dfd-45ff-b943-5c10cb25269f service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:23.520719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094f8d5-7dfd-45ff-b943-5c10cb25269f service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:23.520991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094f8d5-7dfd-45ff-b943-5c10cb25269f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:23.575621 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094f8d5-7dfd-45ff-b943-5c10cb25269f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:23.577100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094f8d5-7dfd-45ff-b943-5c10cb25269f service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:23.586607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1246/2512] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:24.062449 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af48b4e-a323-4210-b396-e0d48eb9bf2f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:24.064146 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af48b4e-a323-4210-b396-e0d48eb9bf2f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:24.064146 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af48b4e-a323-4210-b396-e0d48eb9bf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:24.083060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5af48b4e-a323-4210-b396-e0d48eb9bf2f None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:24.084298 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5af48b4e-a323-4210-b396-e0d48eb9bf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:24.104456 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094f8d5-7dfd-45ff-b943-5c10cb25269f service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:24.115109 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094f8d5-7dfd-45ff-b943-5c10cb25269f service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:24.118910 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd29bad-dd7e-4191-82cd-559e0804316e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:24.119634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd29bad-dd7e-4191-82cd-559e0804316e service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:24.120002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd29bad-dd7e-4191-82cd-559e0804316e service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:24.120387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd29bad-dd7e-4191-82cd-559e0804316e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:24.130243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd29bad-dd7e-4191-82cd-559e0804316e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:24.131791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd29bad-dd7e-4191-82cd-559e0804316e service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:24.144209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1247/2513] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:24.146152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1267/2514] 10.222.0.90 () {58 vars in 967 bytes} [Wed Feb 16 09:33:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:24.195686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd29bad-dd7e-4191-82cd-559e0804316e service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:24.197257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9cd29bad-dd7e-4191-82cd-559e0804316e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:24.269597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd29bad-dd7e-4191-82cd-559e0804316e service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:24.274587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876e5a-2f98-4876-9816-43b7d402c49e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:24.275222 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876e5a-2f98-4876-9816-43b7d402c49e service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:24.275531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876e5a-2f98-4876-9816-43b7d402c49e service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:24.275813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876e5a-2f98-4876-9816-43b7d402c49e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:24.284052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f876e5a-2f98-4876-9816-43b7d402c49e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:24.285910 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f876e5a-2f98-4876-9816-43b7d402c49e service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:24.293775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1248/2515] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:33:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:33:28.005694 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af48b4e-a323-4210-b396-e0d48eb9bf2f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:28.075662 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af48b4e-a323-4210-b396-e0d48eb9bf2f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:28.084304 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:28.085187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:28.085528 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:28.085736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] PATH_INFO: `/v3/users/8f08b759ac3f47a7b38e21d668ec6d6e` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:28.086969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f08b759ac3f47a7b38e21d668ec6d6e)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:28.089062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:28.145402 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f08b759ac3f47a7b38e21d668ec6d6e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.157653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f08b759ac3f47a7b38e21d668ec6d6e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.158482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f08b759ac3f47a7b38e21d668ec6d6e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.167267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f08b759ac3f47a7b38e21d668ec6d6e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.179566 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f08b759ac3f47a7b38e21d668ec6d6e'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.189342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1268/2516] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:33:28 2022] DELETE /identity/v3/users/8f08b759ac3f47a7b38e21d668ec6d6e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:28.194524 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8918b7-6bc2-46ce-ad1e-76e25ca9a443 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:28.195851 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8918b7-6bc2-46ce-ad1e-76e25ca9a443 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:28.196379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8918b7-6bc2-46ce-ad1e-76e25ca9a443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:28.218364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-9f8918b7-6bc2-46ce-ad1e-76e25ca9a443 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:28.220542 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9f8918b7-6bc2-46ce-ad1e-76e25ca9a443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:28.284001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1249/2517] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:28.293942 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:28.295466 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:28.358307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f534eab-f282-4d54-8c6b-9d36aeafe81d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:28.362368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4bf6c-02b5-4705-a890-ddf027bd9577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:28.363097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4bf6c-02b5-4705-a890-ddf027bd9577 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:28.363443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4bf6c-02b5-4705-a890-ddf027bd9577 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:28.363780 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4bf6c-02b5-4705-a890-ddf027bd9577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:28.376228 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4bf6c-02b5-4705-a890-ddf027bd9577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:28.377767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4bf6c-02b5-4705-a890-ddf027bd9577 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:28.387966 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1269/2518] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:28.680608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8918b7-6bc2-46ce-ad1e-76e25ca9a443 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:28.682132 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9f8918b7-6bc2-46ce-ad1e-76e25ca9a443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:28.708273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8918b7-6bc2-46ce-ad1e-76e25ca9a443 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:28.714907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:28.715766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:28.716071 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:28.716348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] PATH_INFO: `/v3/projects/022225c0ecac402997804da54e283a23` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:28.717535 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=022225c0ecac402997804da54e283a23)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:28.720076 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:28.766324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022225c0ecac402997804da54e283a23', 'request_id': 'req-aa093003-cceb-4316-8963-f7f5a360a266'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.771907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022225c0ecac402997804da54e283a23', 'request_id': 'req-aa093003-cceb-4316-8963-f7f5a360a266'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.778315 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022225c0ecac402997804da54e283a23', 'request_id': 'req-aa093003-cceb-4316-8963-f7f5a360a266'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.791449 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] The token cache is being invalidate because project 022225c0ecac402997804da54e283a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:33:28.791730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.792487 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.794026 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1250/2519] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:33:28 2022] DELETE /identity/v3/projects/022225c0ecac402997804da54e283a23 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:28.798295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4bf6c-02b5-4705-a890-ddf027bd9577 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:28.808103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4bf6c-02b5-4705-a890-ddf027bd9577 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:28.864733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:28.865583 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:28.865867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:28.866142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] PATH_INFO: `/v3/users/cb34d16e47494ff7876fb3de41f5331f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:28.867316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb34d16e47494ff7876fb3de41f5331f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:28.869384 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:28.919681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb34d16e47494ff7876fb3de41f5331f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.931027 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb34d16e47494ff7876fb3de41f5331f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.931721 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb34d16e47494ff7876fb3de41f5331f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.939853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb34d16e47494ff7876fb3de41f5331f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.946608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb34d16e47494ff7876fb3de41f5331f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:28.952811 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1270/2520] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:33:28 2022] DELETE /identity/v3/users/cb34d16e47494ff7876fb3de41f5331f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:33:29.360122 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:29.362297 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:29.383555 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa093003-cceb-4316-8963-f7f5a360a266 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:29.465321 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:29.466294 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:29.466629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:29.466964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] PATH_INFO: `/v3/projects/4d82b405891d4481bce5660793434e2e` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:29.468342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d82b405891d4481bce5660793434e2e)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:29.471055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:29.531040 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d82b405891d4481bce5660793434e2e', 'request_id': 'req-1789f478-36e3-4019-926a-4983187e25f2'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:29.537629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d82b405891d4481bce5660793434e2e', 'request_id': 'req-1789f478-36e3-4019-926a-4983187e25f2'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:29.544295 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d82b405891d4481bce5660793434e2e', 'request_id': 'req-1789f478-36e3-4019-926a-4983187e25f2'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:29.557419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] The token cache is being invalidate because project 4d82b405891d4481bce5660793434e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:33:29.557698 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:29.558604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:29.563152 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1251/2521] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:33:29 2022] DELETE /identity/v3/projects/4d82b405891d4481bce5660793434e2e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:29.564460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:29.566477 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:29.583701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc2354-57dc-46b9-8fef-b5b43aee6bed admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:29.775438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98af46-64d1-462f-8812-f32d4da5e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:29.776471 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98af46-64d1-462f-8812-f32d4da5e2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:29.776753 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98af46-64d1-462f-8812-f32d4da5e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:29.777027 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98af46-64d1-462f-8812-f32d4da5e2e5 admin admin] PATH_INFO: `/v3/users/51a07c44f3ed4446b9f0191e95215844` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:29.778224 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98af46-64d1-462f-8812-f32d4da5e2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a07c44f3ed4446b9f0191e95215844)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:29.780166 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98af46-64d1-462f-8812-f32d4da5e2e5 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:29.826657 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0f98af46-64d1-462f-8812-f32d4da5e2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a07c44f3ed4446b9f0191e95215844'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:29.838764 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0f98af46-64d1-462f-8812-f32d4da5e2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a07c44f3ed4446b9f0191e95215844'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:29.839458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0f98af46-64d1-462f-8812-f32d4da5e2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a07c44f3ed4446b9f0191e95215844'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:29.847745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0f98af46-64d1-462f-8812-f32d4da5e2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a07c44f3ed4446b9f0191e95215844'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:29.854513 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-0f98af46-64d1-462f-8812-f32d4da5e2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a07c44f3ed4446b9f0191e95215844'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:29.860970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1271/2522] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:33:29 2022] DELETE /identity/v3/users/51a07c44f3ed4446b9f0191e95215844 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:30.153225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:30.154650 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:30.169311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789f478-36e3-4019-926a-4983187e25f2 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:30.245048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:30.246488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:30.246912 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:30.247338 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac admin admin] PATH_INFO: `/v3/projects/4f1b52fc36c14232a673450ce04c3cd2` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:30.249056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1b52fc36c14232a673450ce04c3cd2)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:30.254305 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:30.305237 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1b52fc36c14232a673450ce04c3cd2', 'request_id': 'req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:30.311054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1b52fc36c14232a673450ce04c3cd2', 'request_id': 'req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:30.317801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1b52fc36c14232a673450ce04c3cd2', 'request_id': 'req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:30.333196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac admin admin] The token cache is being invalidate because project 4f1b52fc36c14232a673450ce04c3cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:33:30.333396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:30.334083 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-414b3f2a-8c66-4d4a-96c8-dd6ae06b6bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:30.335863 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1252/2523] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:33:30 2022] DELETE /identity/v3/projects/4f1b52fc36c14232a673450ce04c3cd2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:30.340687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404c411-5833-47c2-b5b9-04b0d8897407 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:30.340991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404c411-5833-47c2-b5b9-04b0d8897407 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:30.341255 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404c411-5833-47c2-b5b9-04b0d8897407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:30.361702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e404c411-5833-47c2-b5b9-04b0d8897407 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:30.362938 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e404c411-5833-47c2-b5b9-04b0d8897407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:30.424783 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1272/2524] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:30.433798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d33c9-d16c-429c-90e2-a15fbda772c9 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:30.434319 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d33c9-d16c-429c-90e2-a15fbda772c9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:30.434402 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d33c9-d16c-429c-90e2-a15fbda772c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:30.456677 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-468d33c9-d16c-429c-90e2-a15fbda772c9 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:30.458435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-468d33c9-d16c-429c-90e2-a15fbda772c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:30.468291 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1253/2525] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:30.473560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404c411-5833-47c2-b5b9-04b0d8897407 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:30.483368 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404c411-5833-47c2-b5b9-04b0d8897407 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:30.489256 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217c0c6-bda1-49f3-9f99-f2cb3117d1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:30.489911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217c0c6-bda1-49f3-9f99-f2cb3117d1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:30.490190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217c0c6-bda1-49f3-9f99-f2cb3117d1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:30.490457 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217c0c6-bda1-49f3-9f99-f2cb3117d1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:30.491172 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217c0c6-bda1-49f3-9f99-f2cb3117d1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:33:30.491472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217c0c6-bda1-49f3-9f99-f2cb3117d1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:30.493087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217c0c6-bda1-49f3-9f99-f2cb3117d1d0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:30.506401 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1273/2526] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:33:30.510919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d33c9-d16c-429c-90e2-a15fbda772c9 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:30.521048 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d33c9-d16c-429c-90e2-a15fbda772c9 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:30.525913 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13cbbf-58e5-4e5e-aacf-440c9d51a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:30.526573 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13cbbf-58e5-4e5e-aacf-440c9d51a889 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:30.527602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13cbbf-58e5-4e5e-aacf-440c9d51a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:30.527882 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13cbbf-58e5-4e5e-aacf-440c9d51a889 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:30.528607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13cbbf-58e5-4e5e-aacf-440c9d51a889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:30.530690 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13cbbf-58e5-4e5e-aacf-440c9d51a889 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:30.572056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1254/2527] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:33:30 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:33:30.577195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217c0c6-bda1-49f3-9f99-f2cb3117d1d0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:30.588068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217c0c6-bda1-49f3-9f99-f2cb3117d1d0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:30.658012 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b34e-d43a-46f1-9568-fcbd5bd9bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:30.658687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b34e-d43a-46f1-9568-fcbd5bd9bcc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:30.658971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b34e-d43a-46f1-9568-fcbd5bd9bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:30.659244 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0b34e-d43a-46f1-9568-fcbd5bd9bcc3 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:30.659929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0b34e-d43a-46f1-9568-fcbd5bd9bcc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:30.662167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0b34e-d43a-46f1-9568-fcbd5bd9bcc3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:30.684782 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1274/2528] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:33:30 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:33:30.689686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13cbbf-58e5-4e5e-aacf-440c9d51a889 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:30.700225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13cbbf-58e5-4e5e-aacf-440c9d51a889 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:30.708849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34397e8f-84ec-4708-947d-0d8e42a4d394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:30.709514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34397e8f-84ec-4708-947d-0d8e42a4d394 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:30.709792 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34397e8f-84ec-4708-947d-0d8e42a4d394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:30.710064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34397e8f-84ec-4708-947d-0d8e42a4d394 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:30.710779 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34397e8f-84ec-4708-947d-0d8e42a4d394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:30.712433 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34397e8f-84ec-4708-947d-0d8e42a4d394 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:30.724395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1255/2529] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:33:30.728526 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b34e-d43a-46f1-9568-fcbd5bd9bcc3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:30.738472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0b34e-d43a-46f1-9568-fcbd5bd9bcc3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:30.743127 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf01d9-72f7-4d0f-b9e2-9866787c7ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:30.743774 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf01d9-72f7-4d0f-b9e2-9866787c7ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:30.744087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf01d9-72f7-4d0f-b9e2-9866787c7ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:30.744366 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf01d9-72f7-4d0f-b9e2-9866787c7ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:30.745081 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf01d9-72f7-4d0f-b9e2-9866787c7ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:30.746678 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf01d9-72f7-4d0f-b9e2-9866787c7ee7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:30.757314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1275/2530] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:33:30.761514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34397e8f-84ec-4708-947d-0d8e42a4d394 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:30.772430 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34397e8f-84ec-4708-947d-0d8e42a4d394 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:30.777153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212064f-b4b5-4a73-93b4-bafadb367a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:30.778027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212064f-b4b5-4a73-93b4-bafadb367a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:30.778305 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212064f-b4b5-4a73-93b4-bafadb367a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:30.778584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212064f-b4b5-4a73-93b4-bafadb367a08 admin admin] PATH_INFO: `/v3/projects/c9ff11adcf524dcfb440adeff165bd78/users/58bede75b3524851940db7475771146b/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:30.794187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212064f-b4b5-4a73-93b4-bafadb367a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ff11adcf524dcfb440adeff165bd78, user_id=58bede75b3524851940db7475771146b, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:30.796888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212064f-b4b5-4a73-93b4-bafadb367a08 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:30.811893 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1256/2531] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:33:30 2022] PUT /identity/v3/projects/c9ff11adcf524dcfb440adeff165bd78/users/58bede75b3524851940db7475771146b/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:33:30.818142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b02a76-5eb5-4d5a-81eb-ee6669c02a25 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:30.818505 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b02a76-5eb5-4d5a-81eb-ee6669c02a25 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:30.818945 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b02a76-5eb5-4d5a-81eb-ee6669c02a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:30.836993 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-37b02a76-5eb5-4d5a-81eb-ee6669c02a25 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:30.838260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-37b02a76-5eb5-4d5a-81eb-ee6669c02a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:30.900802 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1276/2532] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:30.918303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212064f-b4b5-4a73-93b4-bafadb367a08 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:30.920390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f212064f-b4b5-4a73-93b4-bafadb367a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:30.981499 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212064f-b4b5-4a73-93b4-bafadb367a08 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:30.986282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf000e17-492e-4dcb-b055-6dd8e9dbf6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:30.987019 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000e17-492e-4dcb-b055-6dd8e9dbf6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:30.987363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000e17-492e-4dcb-b055-6dd8e9dbf6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:30.987706 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000e17-492e-4dcb-b055-6dd8e9dbf6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:30.997658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf000e17-492e-4dcb-b055-6dd8e9dbf6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:30.999206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf000e17-492e-4dcb-b055-6dd8e9dbf6d2 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:31.014626 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1257/2533] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:31.977217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b02a76-5eb5-4d5a-81eb-ee6669c02a25 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:31.978747 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-37b02a76-5eb5-4d5a-81eb-ee6669c02a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:31.993989 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b02a76-5eb5-4d5a-81eb-ee6669c02a25 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:32.007053 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:32.007966 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:32.014683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:32.014683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] PATH_INFO: `/v3/users/b3065c8eadb94eb79ccd835729fafc02` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:32.014683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3065c8eadb94eb79ccd835729fafc02)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:32.014683 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:32.039516 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2a74-7ac1-4916-b216-ce94c1c50abb None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:32.040090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2a74-7ac1-4916-b216-ce94c1c50abb None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:32.040090 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae2a74-7ac1-4916-b216-ce94c1c50abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:32.066659 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3065c8eadb94eb79ccd835729fafc02'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.069856 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-16ae2a74-7ac1-4916-b216-ce94c1c50abb None None] MFA Rules not processed for user `58bede75b3524851940db7475771146b`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:32.071670 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-16ae2a74-7ac1-4916-b216-ce94c1c50abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:32.079371 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3065c8eadb94eb79ccd835729fafc02'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.080721 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3065c8eadb94eb79ccd835729fafc02'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.088398 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3065c8eadb94eb79ccd835729fafc02'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.096443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3065c8eadb94eb79ccd835729fafc02'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.102785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1277/2534] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:33:31 2022] DELETE /identity/v3/users/b3065c8eadb94eb79ccd835729fafc02 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:33:32.150108 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1258/2535] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:32.163378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:32.164835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:32.226319 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f6147-5186-4b6e-99df-b1ac570bb6ad admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:32.229945 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d67ad-fa71-4d94-853c-093412864003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:32.230584 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d67ad-fa71-4d94-853c-093412864003 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:32.230862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d67ad-fa71-4d94-853c-093412864003 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:32.231136 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d67ad-fa71-4d94-853c-093412864003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:32.292282 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d67ad-fa71-4d94-853c-093412864003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:32.293177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae2a74-7ac1-4916-b216-ce94c1c50abb None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:32.293765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d67ad-fa71-4d94-853c-093412864003 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:32.300445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-16ae2a74-7ac1-4916-b216-ce94c1c50abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:32.308732 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1278/2536] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:32.318919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae2a74-7ac1-4916-b216-ce94c1c50abb None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:32.377230 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:32.378008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:32.378322 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:32.378595 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] PATH_INFO: `/v3/projects/95e44d55b575475e983667536f98ba1b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:32.379831 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e44d55b575475e983667536f98ba1b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:32.382025 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:32.430490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e44d55b575475e983667536f98ba1b', 'request_id': 'req-f970c45f-bc06-4e38-bba9-43159524af44'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.436241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e44d55b575475e983667536f98ba1b', 'request_id': 'req-f970c45f-bc06-4e38-bba9-43159524af44'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.443388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e44d55b575475e983667536f98ba1b', 'request_id': 'req-f970c45f-bc06-4e38-bba9-43159524af44'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.457166 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] The token cache is being invalidate because project 95e44d55b575475e983667536f98ba1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:33:32.457585 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.458387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.460171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1259/2537] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:33:32 2022] DELETE /identity/v3/projects/95e44d55b575475e983667536f98ba1b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:32.464179 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d67ad-fa71-4d94-853c-093412864003 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:32.476293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d67ad-fa71-4d94-853c-093412864003 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:32.538575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c89a6-547f-485b-9ca5-870d48fcdeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:32.539437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c89a6-547f-485b-9ca5-870d48fcdeea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:32.539718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c89a6-547f-485b-9ca5-870d48fcdeea admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:32.539990 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c89a6-547f-485b-9ca5-870d48fcdeea admin admin] PATH_INFO: `/v3/users/2997f2b87c2e4be0aa90f3a9e153c243` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:32.541220 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c89a6-547f-485b-9ca5-870d48fcdeea admin admin] RBAC: Authorizing `identity:delete_user(user_id=2997f2b87c2e4be0aa90f3a9e153c243)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:32.543109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c89a6-547f-485b-9ca5-870d48fcdeea admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:32.595230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1a2c89a6-547f-485b-9ca5-870d48fcdeea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2997f2b87c2e4be0aa90f3a9e153c243'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.608400 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1a2c89a6-547f-485b-9ca5-870d48fcdeea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2997f2b87c2e4be0aa90f3a9e153c243'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.609211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1a2c89a6-547f-485b-9ca5-870d48fcdeea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2997f2b87c2e4be0aa90f3a9e153c243'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.618306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1a2c89a6-547f-485b-9ca5-870d48fcdeea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2997f2b87c2e4be0aa90f3a9e153c243'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.627574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1a2c89a6-547f-485b-9ca5-870d48fcdeea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2997f2b87c2e4be0aa90f3a9e153c243'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.633522 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1279/2538] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:33:32 2022] DELETE /identity/v3/users/2997f2b87c2e4be0aa90f3a9e153c243 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:32.803066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:32.804547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:32.818205 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970c45f-bc06-4e38-bba9-43159524af44 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:32.872129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:32.872976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:32.873251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:32.873520 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] PATH_INFO: `/v3/projects/426013f10809459289e69d69c8bc475c` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:32.874666 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] RBAC: Authorizing `identity:delete_project(project_id=426013f10809459289e69d69c8bc475c)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:32.877188 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:32.921506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426013f10809459289e69d69c8bc475c', 'request_id': 'req-0a687508-c9ed-4ac1-9ba6-1e71a195670c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.927508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426013f10809459289e69d69c8bc475c', 'request_id': 'req-0a687508-c9ed-4ac1-9ba6-1e71a195670c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.933934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426013f10809459289e69d69c8bc475c', 'request_id': 'req-0a687508-c9ed-4ac1-9ba6-1e71a195670c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.946254 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] The token cache is being invalidate because project 426013f10809459289e69d69c8bc475c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:33:32.946541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.947163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:33:32.948751 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1260/2539] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:33:32 2022] DELETE /identity/v3/projects/426013f10809459289e69d69c8bc475c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:33:33.679860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbbea9-19e0-43da-ba81-1f6eea6ebb49 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:33.680751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbbea9-19e0-43da-ba81-1f6eea6ebb49 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:33.680751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbbea9-19e0-43da-ba81-1f6eea6ebb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:33.702430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-58dbbea9-19e0-43da-ba81-1f6eea6ebb49 None None] MFA Rules not processed for user `58bede75b3524851940db7475771146b`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:33.703791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-58dbbea9-19e0-43da-ba81-1f6eea6ebb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:33.764834 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1280/2540] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:33:34.018937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:34.020413 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:34.076440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a687508-c9ed-4ac1-9ba6-1e71a195670c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:34.080260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c50abd-5a70-4278-8a56-ae3955596e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:34.080907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c50abd-5a70-4278-8a56-ae3955596e8b service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:34.081183 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c50abd-5a70-4278-8a56-ae3955596e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:34.081455 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c50abd-5a70-4278-8a56-ae3955596e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:34.083202 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-12c50abd-5a70-4278-8a56-ae3955596e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:34.092291 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c50abd-5a70-4278-8a56-ae3955596e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:34.093714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c50abd-5a70-4278-8a56-ae3955596e8b service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:34.101982 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1261/2541] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:33:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:39.333912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b9f3-3fb1-45c1-8d1a-d57cc4894ce6 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:39.334426 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b9f3-3fb1-45c1-8d1a-d57cc4894ce6 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:39.334426 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b9f3-3fb1-45c1-8d1a-d57cc4894ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:39.351458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b260b9f3-3fb1-45c1-8d1a-d57cc4894ce6 None None] MFA Rules not processed for user `e277c102c82b412481a8a9f888f4a7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:39.352671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b260b9f3-3fb1-45c1-8d1a-d57cc4894ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:39.404795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1281/2542] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:49.188854 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73a49a-1026-4573-af25-3d84ab3eb6c1 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:49.189363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73a49a-1026-4573-af25-3d84ab3eb6c1 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:49.189461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73a49a-1026-4573-af25-3d84ab3eb6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:49.207391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-af73a49a-1026-4573-af25-3d84ab3eb6c1 None None] MFA Rules not processed for user `53dc4402074b44deb42d688bc302a58c`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:49.208610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-af73a49a-1026-4573-af25-3d84ab3eb6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:49.261036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1262/2543] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:33:53.485104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b9f3-3fb1-45c1-8d1a-d57cc4894ce6 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:33:53.494598 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b9f3-3fb1-45c1-8d1a-d57cc4894ce6 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:33:53.498271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cb04e-f4c7-4a33-a7a2-b42b7c67f1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:33:53.498988 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cb04e-f4c7-4a33-a7a2-b42b7c67f1ab service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:53.499264 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cb04e-f4c7-4a33-a7a2-b42b7c67f1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:53.499537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cb04e-f4c7-4a33-a7a2-b42b7c67f1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:53.501626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-484cb04e-f4c7-4a33-a7a2-b42b7c67f1ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:53.512682 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cb04e-f4c7-4a33-a7a2-b42b7c67f1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:33:53.514108 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484cb04e-f4c7-4a33-a7a2-b42b7c67f1ab service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:33:53.523988 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1282/2544] 10.222.0.90 () {60 vars in 1396 bytes} [Wed Feb 16 09:33:53 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:33:56.116150 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a540b-ff63-43fe-ab35-f6b37f8d5bec None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:33:56.116690 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a540b-ff63-43fe-ab35-f6b37f8d5bec None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:33:56.116690 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a540b-ff63-43fe-ab35-f6b37f8d5bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:33:56.135454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-409a540b-ff63-43fe-ab35-f6b37f8d5bec None None] MFA Rules not processed for user `58bede75b3524851940db7475771146b`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:33:56.136686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-409a540b-ff63-43fe-ab35-f6b37f8d5bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:33:56.144246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1263/2545] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:33:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:34:16.246852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28de75-24e9-4b92-b1d7-20ca360ac654 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:16.247367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28de75-24e9-4b92-b1d7-20ca360ac654 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:16.247498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28de75-24e9-4b92-b1d7-20ca360ac654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:16.266887 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0d28de75-24e9-4b92-b1d7-20ca360ac654 None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:34:16.268152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0d28de75-24e9-4b92-b1d7-20ca360ac654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:34:16.323911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1283/2546] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:34:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:34:16.336637 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a540b-ff63-43fe-ab35-f6b37f8d5bec None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:16.338098 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-409a540b-ff63-43fe-ab35-f6b37f8d5bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:34:16.414123 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a540b-ff63-43fe-ab35-f6b37f8d5bec None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:16.420403 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28742f4c-79cc-4eb3-8120-5256a8c1e67f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:16.421125 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28742f4c-79cc-4eb3-8120-5256a8c1e67f service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:16.421410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28742f4c-79cc-4eb3-8120-5256a8c1e67f service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:16.421685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28742f4c-79cc-4eb3-8120-5256a8c1e67f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:16.433615 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28742f4c-79cc-4eb3-8120-5256a8c1e67f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:16.435530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28742f4c-79cc-4eb3-8120-5256a8c1e67f service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:16.443972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1264/2547] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 09:34:32.171262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d5fd8-b2c7-469d-ae13-503f73876b43 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:32.171705 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d5fd8-b2c7-469d-ae13-503f73876b43 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:32.171802 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d5fd8-b2c7-469d-ae13-503f73876b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:32.189715 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c01d5fd8-b2c7-469d-ae13-503f73876b43 None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:34:32.190902 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c01d5fd8-b2c7-469d-ae13-503f73876b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:34:32.198198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1284/2548] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:34:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:34:32.211775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28742f4c-79cc-4eb3-8120-5256a8c1e67f service swift] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:32.222335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28742f4c-79cc-4eb3-8120-5256a8c1e67f service swift] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:32.227734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824a99e-7260-4e68-81fb-9a66080f5006 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:32.228404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824a99e-7260-4e68-81fb-9a66080f5006 service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:32.228704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824a99e-7260-4e68-81fb-9a66080f5006 service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:32.228962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824a99e-7260-4e68-81fb-9a66080f5006 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:32.237945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824a99e-7260-4e68-81fb-9a66080f5006 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:32.239201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824a99e-7260-4e68-81fb-9a66080f5006 service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:32.247292 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1265/2549] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:34:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:34:33.276867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eef373-c1dc-43cc-9732-9c80da005a4d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:33.276867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eef373-c1dc-43cc-9732-9c80da005a4d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:33.277511 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eef373-c1dc-43cc-9732-9c80da005a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:33.298085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-71eef373-c1dc-43cc-9732-9c80da005a4d None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:34:33.298085 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-71eef373-c1dc-43cc-9732-9c80da005a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:34:33.306612 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1285/2550] 10.222.0.90 () {58 vars in 967 bytes} [Wed Feb 16 09:34:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:34:33.322709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824a99e-7260-4e68-81fb-9a66080f5006 service swift] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:33.334146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824a99e-7260-4e68-81fb-9a66080f5006 service swift] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:33.339357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9068d4-77cd-4de2-9b39-00b15e084ef2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:33.340011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9068d4-77cd-4de2-9b39-00b15e084ef2 service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:33.340328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9068d4-77cd-4de2-9b39-00b15e084ef2 service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:33.340611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9068d4-77cd-4de2-9b39-00b15e084ef2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:33.350417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9068d4-77cd-4de2-9b39-00b15e084ef2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:33.351991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9068d4-77cd-4de2-9b39-00b15e084ef2 service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:33.360567 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1266/2551] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:34:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:34:35.682965 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eef373-c1dc-43cc-9732-9c80da005a4d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:35.686320 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-71eef373-c1dc-43cc-9732-9c80da005a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:34:35.788389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eef373-c1dc-43cc-9732-9c80da005a4d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:35.796776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2978fb7-7300-41de-88de-6ecf0dee079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:35.798244 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2978fb7-7300-41de-88de-6ecf0dee079e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:35.798730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2978fb7-7300-41de-88de-6ecf0dee079e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:35.799003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2978fb7-7300-41de-88de-6ecf0dee079e admin admin] PATH_INFO: `/v3/users/58bede75b3524851940db7475771146b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:35.800244 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2978fb7-7300-41de-88de-6ecf0dee079e admin admin] RBAC: Authorizing `identity:delete_user(user_id=58bede75b3524851940db7475771146b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:35.802445 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2978fb7-7300-41de-88de-6ecf0dee079e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:35.880620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a2978fb7-7300-41de-88de-6ecf0dee079e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58bede75b3524851940db7475771146b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:34:35.901897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a2978fb7-7300-41de-88de-6ecf0dee079e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58bede75b3524851940db7475771146b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:34:35.903052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a2978fb7-7300-41de-88de-6ecf0dee079e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58bede75b3524851940db7475771146b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:34:35.917758 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a2978fb7-7300-41de-88de-6ecf0dee079e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58bede75b3524851940db7475771146b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:34:35.928710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a2978fb7-7300-41de-88de-6ecf0dee079e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58bede75b3524851940db7475771146b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:34:35.935246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1286/2552] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:34:35 2022] DELETE /identity/v3/users/58bede75b3524851940db7475771146b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:34:36.142129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9068d4-77cd-4de2-9b39-00b15e084ef2 service swift] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:36.153107 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9068d4-77cd-4de2-9b39-00b15e084ef2 service swift] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:36.245970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfa556-61d8-40f2-a1e2-5df485351cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:36.246891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfa556-61d8-40f2-a1e2-5df485351cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:36.247178 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfa556-61d8-40f2-a1e2-5df485351cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:36.247456 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfa556-61d8-40f2-a1e2-5df485351cd9 admin admin] PATH_INFO: `/v3/projects/c9ff11adcf524dcfb440adeff165bd78` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:36.248693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfa556-61d8-40f2-a1e2-5df485351cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ff11adcf524dcfb440adeff165bd78)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:36.251251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfa556-61d8-40f2-a1e2-5df485351cd9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:36.308170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-81cfa556-61d8-40f2-a1e2-5df485351cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ff11adcf524dcfb440adeff165bd78', 'request_id': 'req-81cfa556-61d8-40f2-a1e2-5df485351cd9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:34:36.315278 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-81cfa556-61d8-40f2-a1e2-5df485351cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ff11adcf524dcfb440adeff165bd78', 'request_id': 'req-81cfa556-61d8-40f2-a1e2-5df485351cd9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:34:36.324244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-81cfa556-61d8-40f2-a1e2-5df485351cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ff11adcf524dcfb440adeff165bd78', 'request_id': 'req-81cfa556-61d8-40f2-a1e2-5df485351cd9'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:34:36.341828 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-81cfa556-61d8-40f2-a1e2-5df485351cd9 admin admin] The token cache is being invalidate because project c9ff11adcf524dcfb440adeff165bd78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:34:36.342246 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-81cfa556-61d8-40f2-a1e2-5df485351cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:34:36.342945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-81cfa556-61d8-40f2-a1e2-5df485351cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:34:36.345883 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1267/2553] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:34:36 2022] DELETE /identity/v3/projects/c9ff11adcf524dcfb440adeff165bd78 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:34:36.350607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0176f-79c1-46cd-837d-dc2cd1474ce5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:36.350992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0176f-79c1-46cd-837d-dc2cd1474ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:36.351289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0176f-79c1-46cd-837d-dc2cd1474ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:36.374886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a0c0176f-79c1-46cd-837d-dc2cd1474ce5 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:34:36.377603 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a0c0176f-79c1-46cd-837d-dc2cd1474ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:34:36.453096 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1287/2554] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:34:36.462226 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185ee49-c3cf-462a-a7a0-083acfdab287 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:36.462515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185ee49-c3cf-462a-a7a0-083acfdab287 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:36.462799 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185ee49-c3cf-462a-a7a0-083acfdab287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:36.483824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-c185ee49-c3cf-462a-a7a0-083acfdab287 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:34:36.485888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c185ee49-c3cf-462a-a7a0-083acfdab287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:34:36.494550 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1268/2555] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:34:36.499029 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0176f-79c1-46cd-837d-dc2cd1474ce5 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:36.513645 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0176f-79c1-46cd-837d-dc2cd1474ce5 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:36.521222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466e7f3-96c4-4827-a2b7-ff874781c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:36.523204 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e7f3-96c4-4827-a2b7-ff874781c003 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:36.523562 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e7f3-96c4-4827-a2b7-ff874781c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:36.523918 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466e7f3-96c4-4827-a2b7-ff874781c003 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:36.524787 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466e7f3-96c4-4827-a2b7-ff874781c003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:34:36.525167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466e7f3-96c4-4827-a2b7-ff874781c003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:36.529591 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6466e7f3-96c4-4827-a2b7-ff874781c003 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:36.549362 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1288/2556] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:34:36.550719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185ee49-c3cf-462a-a7a0-083acfdab287 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:36.561390 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185ee49-c3cf-462a-a7a0-083acfdab287 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:36.569972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204adcc-dc2a-4aac-a5b1-354295fb507e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:36.570771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204adcc-dc2a-4aac-a5b1-354295fb507e admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:36.571146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204adcc-dc2a-4aac-a5b1-354295fb507e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:36.571497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204adcc-dc2a-4aac-a5b1-354295fb507e admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:36.576993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204adcc-dc2a-4aac-a5b1-354295fb507e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:36.580634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204adcc-dc2a-4aac-a5b1-354295fb507e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:36.624227 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1269/2557] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:34:36 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:34:36.628668 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466e7f3-96c4-4827-a2b7-ff874781c003 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:36.643449 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466e7f3-96c4-4827-a2b7-ff874781c003 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:36.719764 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a187675-e0f0-4a0f-8519-4b295a7c6e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:36.720485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a187675-e0f0-4a0f-8519-4b295a7c6e94 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:36.720973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a187675-e0f0-4a0f-8519-4b295a7c6e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:36.721509 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a187675-e0f0-4a0f-8519-4b295a7c6e94 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:36.722406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a187675-e0f0-4a0f-8519-4b295a7c6e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:36.724449 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a187675-e0f0-4a0f-8519-4b295a7c6e94 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:36.764849 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1289/2558] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:34:36 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:34:36.766512 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204adcc-dc2a-4aac-a5b1-354295fb507e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:36.783125 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204adcc-dc2a-4aac-a5b1-354295fb507e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:36.790010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f19aa-4cbb-4b88-9f73-e86847d81435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:36.791001 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f19aa-4cbb-4b88-9f73-e86847d81435 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:36.791651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f19aa-4cbb-4b88-9f73-e86847d81435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:36.792527 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f19aa-4cbb-4b88-9f73-e86847d81435 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:36.796398 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f19aa-4cbb-4b88-9f73-e86847d81435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:36.798879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f19aa-4cbb-4b88-9f73-e86847d81435 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:36.812811 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1270/2559] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:34:36.814661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a187675-e0f0-4a0f-8519-4b295a7c6e94 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:36.829161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a187675-e0f0-4a0f-8519-4b295a7c6e94 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:36.834948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1d9fb-e9dc-4c1d-b5a9-22da40a306c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:36.835626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1d9fb-e9dc-4c1d-b5a9-22da40a306c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:36.835908 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1d9fb-e9dc-4c1d-b5a9-22da40a306c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:36.836210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1d9fb-e9dc-4c1d-b5a9-22da40a306c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:36.836935 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1d9fb-e9dc-4c1d-b5a9-22da40a306c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:36.838534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1d9fb-e9dc-4c1d-b5a9-22da40a306c9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:36.853338 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1290/2560] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:34:36.854405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f19aa-4cbb-4b88-9f73-e86847d81435 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:36.865836 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f19aa-4cbb-4b88-9f73-e86847d81435 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:36.872144 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4925783-5cc3-4e9b-90d9-983ff4b55316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:36.873146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4925783-5cc3-4e9b-90d9-983ff4b55316 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:36.873530 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4925783-5cc3-4e9b-90d9-983ff4b55316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:36.873872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4925783-5cc3-4e9b-90d9-983ff4b55316 admin admin] PATH_INFO: `/v3/projects/638d8684293e4c66bbdd4ec60a7d590e/users/5e946ed617e54e51a5d624537b0773ff/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:36.893629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4925783-5cc3-4e9b-90d9-983ff4b55316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638d8684293e4c66bbdd4ec60a7d590e, user_id=5e946ed617e54e51a5d624537b0773ff, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:36.896471 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4925783-5cc3-4e9b-90d9-983ff4b55316 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:36.915618 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1271/2561] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:34:36 2022] PUT /identity/v3/projects/638d8684293e4c66bbdd4ec60a7d590e/users/5e946ed617e54e51a5d624537b0773ff/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:34:36.985317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b817a5-d6c0-4f2e-a78d-45299e7d43d2 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:36.986104 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b817a5-d6c0-4f2e-a78d-45299e7d43d2 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:36.986658 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b817a5-d6c0-4f2e-a78d-45299e7d43d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:37.018517 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-46b817a5-d6c0-4f2e-a78d-45299e7d43d2 None None] MFA Rules not processed for user `5e946ed617e54e51a5d624537b0773ff`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:34:37.020056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-46b817a5-d6c0-4f2e-a78d-45299e7d43d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:34:37.100181 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1291/2562] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:34:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:34:37.110383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4925783-5cc3-4e9b-90d9-983ff4b55316 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:37.112300 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e4925783-5cc3-4e9b-90d9-983ff4b55316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:34:37.182431 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4925783-5cc3-4e9b-90d9-983ff4b55316 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:37.186556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc526c87-5f36-404a-af84-d91d4d5cde8d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5074090dca0b4a49b54dc252a5dd9420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:37.187288 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc526c87-5f36-404a-af84-d91d4d5cde8d service glance] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:37.188214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc526c87-5f36-404a-af84-d91d4d5cde8d service glance] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:37.188687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc526c87-5f36-404a-af84-d91d4d5cde8d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:37.200774 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc526c87-5f36-404a-af84-d91d4d5cde8d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:37.202325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc526c87-5f36-404a-af84-d91d4d5cde8d service glance] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:37.213198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1272/2563] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:34:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:34:47.833490 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642c218-fcd2-40af-88f1-42b90a1cf49f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:47.833986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642c218-fcd2-40af-88f1-42b90a1cf49f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:47.834084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642c218-fcd2-40af-88f1-42b90a1cf49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:47.852253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-1642c218-fcd2-40af-88f1-42b90a1cf49f None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:34:47.853466 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-1642c218-fcd2-40af-88f1-42b90a1cf49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:34:47.906577 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1292/2564] 10.222.0.90 () {58 vars in 1009 bytes} [Wed Feb 16 09:34:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:34:47.919291 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc526c87-5f36-404a-af84-d91d4d5cde8d service glance] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:34:47.920789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-bc526c87-5f36-404a-af84-d91d4d5cde8d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:34:47.998349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc526c87-5f36-404a-af84-d91d4d5cde8d service glance] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:34:48.003382 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301890ec-1f51-452f-bc39-eaa413b75b4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:34:48.004013 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301890ec-1f51-452f-bc39-eaa413b75b4f service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:34:48.004329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301890ec-1f51-452f-bc39-eaa413b75b4f service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:34:48.004602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301890ec-1f51-452f-bc39-eaa413b75b4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:34:48.012582 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301890ec-1f51-452f-bc39-eaa413b75b4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:34:48.014167 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301890ec-1f51-452f-bc39-eaa413b75b4f service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:34:48.022814 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1273/2565] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:34:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 09:35:07.391290 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011271be-7a1d-41bb-80e1-ef220c4d5b66 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:07.391940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011271be-7a1d-41bb-80e1-ef220c4d5b66 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:07.391940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011271be-7a1d-41bb-80e1-ef220c4d5b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:07.409859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-011271be-7a1d-41bb-80e1-ef220c4d5b66 None None] MFA Rules not processed for user `ffcd409f87f84fe3bf25715e84c41af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:07.411626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-011271be-7a1d-41bb-80e1-ef220c4d5b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:07.418859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1293/2566] 10.222.0.90 () {58 vars in 967 bytes} [Wed Feb 16 09:35:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:07.432563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301890ec-1f51-452f-bc39-eaa413b75b4f service swift] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:07.443178 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301890ec-1f51-452f-bc39-eaa413b75b4f service swift] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:07.448443 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068156b6-67e7-4d0b-b5cb-33ba567d1e31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf1f200fb2b4a2fb75b971054885eef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:07.449138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068156b6-67e7-4d0b-b5cb-33ba567d1e31 service swift] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:07.449419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068156b6-67e7-4d0b-b5cb-33ba567d1e31 service swift] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:07.449695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068156b6-67e7-4d0b-b5cb-33ba567d1e31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:07.459472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068156b6-67e7-4d0b-b5cb-33ba567d1e31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:07.461826 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068156b6-67e7-4d0b-b5cb-33ba567d1e31 service swift] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:07.473477 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1274/2567] 10.222.0.90 () {60 vars in 1384 bytes} [Wed Feb 16 09:35:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 09:35:11.596996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011271be-7a1d-41bb-80e1-ef220c4d5b66 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:11.658000 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011271be-7a1d-41bb-80e1-ef220c4d5b66 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:11.662771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:11.663624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:11.663904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:11.664475 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] PATH_INFO: `/v3/users/5e946ed617e54e51a5d624537b0773ff` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:11.665667 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e946ed617e54e51a5d624537b0773ff)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:11.667569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:11.711128 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e946ed617e54e51a5d624537b0773ff'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:11.722122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e946ed617e54e51a5d624537b0773ff'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:11.722811 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e946ed617e54e51a5d624537b0773ff'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:11.729376 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e946ed617e54e51a5d624537b0773ff'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:11.735830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e946ed617e54e51a5d624537b0773ff'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:11.741714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1294/2568] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:35:11 2022] DELETE /identity/v3/users/5e946ed617e54e51a5d624537b0773ff => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:11.746198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89007b4-7627-4e67-98c9-15b319c01eff None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:11.746673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89007b4-7627-4e67-98c9-15b319c01eff None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:11.746770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89007b4-7627-4e67-98c9-15b319c01eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:11.764391 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-e89007b4-7627-4e67-98c9-15b319c01eff None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:11.765570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e89007b4-7627-4e67-98c9-15b319c01eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:11.837687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1275/2569] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:11.847275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:11.849098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:11.908487 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7444b-4308-491d-8132-6b10ccaf3e91 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:11.913329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083071f-09f9-4abf-9c73-5975aa4da500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:11.914068 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083071f-09f9-4abf-9c73-5975aa4da500 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:11.914684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083071f-09f9-4abf-9c73-5975aa4da500 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:11.914960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083071f-09f9-4abf-9c73-5975aa4da500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:11.924340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083071f-09f9-4abf-9c73-5975aa4da500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:11.926295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083071f-09f9-4abf-9c73-5975aa4da500 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:11.936087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1295/2570] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:35:12.218005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89007b4-7627-4e67-98c9-15b319c01eff None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:12.219505 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e89007b4-7627-4e67-98c9-15b319c01eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:12.235293 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89007b4-7627-4e67-98c9-15b319c01eff None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:12.242446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01716b70-1b67-4e78-b9c3-8c030300b78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:12.243321 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01716b70-1b67-4e78-b9c3-8c030300b78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:12.243765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01716b70-1b67-4e78-b9c3-8c030300b78c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:12.244228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01716b70-1b67-4e78-b9c3-8c030300b78c admin admin] PATH_INFO: `/v3/projects/638d8684293e4c66bbdd4ec60a7d590e` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:12.245522 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01716b70-1b67-4e78-b9c3-8c030300b78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=638d8684293e4c66bbdd4ec60a7d590e)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:12.247304 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01716b70-1b67-4e78-b9c3-8c030300b78c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:12.301232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-01716b70-1b67-4e78-b9c3-8c030300b78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638d8684293e4c66bbdd4ec60a7d590e', 'request_id': 'req-01716b70-1b67-4e78-b9c3-8c030300b78c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:12.306939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-01716b70-1b67-4e78-b9c3-8c030300b78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638d8684293e4c66bbdd4ec60a7d590e', 'request_id': 'req-01716b70-1b67-4e78-b9c3-8c030300b78c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:12.313746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-01716b70-1b67-4e78-b9c3-8c030300b78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638d8684293e4c66bbdd4ec60a7d590e', 'request_id': 'req-01716b70-1b67-4e78-b9c3-8c030300b78c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:12.326994 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-01716b70-1b67-4e78-b9c3-8c030300b78c admin admin] The token cache is being invalidate because project 638d8684293e4c66bbdd4ec60a7d590e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:35:12.327251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-01716b70-1b67-4e78-b9c3-8c030300b78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:12.327899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-01716b70-1b67-4e78-b9c3-8c030300b78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:12.329743 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1276/2571] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:35:12 2022] DELETE /identity/v3/projects/638d8684293e4c66bbdd4ec60a7d590e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:12.335174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a8dbf-c647-4f79-a941-ae6ec0089f7b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:12.335467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a8dbf-c647-4f79-a941-ae6ec0089f7b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:12.335744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a8dbf-c647-4f79-a941-ae6ec0089f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:12.353602 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f44a8dbf-c647-4f79-a941-ae6ec0089f7b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:12.354795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f44a8dbf-c647-4f79-a941-ae6ec0089f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:12.413884 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1296/2572] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:12.422845 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de60b7-5c43-4ac6-8e10-ad062d11890d None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:12.423235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de60b7-5c43-4ac6-8e10-ad062d11890d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:12.423587 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de60b7-5c43-4ac6-8e10-ad062d11890d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:12.444106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-47de60b7-5c43-4ac6-8e10-ad062d11890d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:12.445337 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-47de60b7-5c43-4ac6-8e10-ad062d11890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:12.453773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1277/2573] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:12.459299 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a8dbf-c647-4f79-a941-ae6ec0089f7b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:12.469208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a8dbf-c647-4f79-a941-ae6ec0089f7b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:12.474054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a5254-ccc6-493d-93ff-276c8e4ea1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:12.474743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a5254-ccc6-493d-93ff-276c8e4ea1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:12.475040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a5254-ccc6-493d-93ff-276c8e4ea1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:12.475308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a5254-ccc6-493d-93ff-276c8e4ea1f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:12.476055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a5254-ccc6-493d-93ff-276c8e4ea1f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:35:12.476544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a5254-ccc6-493d-93ff-276c8e4ea1f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:12.478143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a5254-ccc6-493d-93ff-276c8e4ea1f9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:12.492917 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1297/2574] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:35:12.494008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de60b7-5c43-4ac6-8e10-ad062d11890d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:12.503235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de60b7-5c43-4ac6-8e10-ad062d11890d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:12.508635 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07854ad3-47b5-476d-b91c-50c1b67c1c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:12.509286 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07854ad3-47b5-476d-b91c-50c1b67c1c11 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:12.509569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07854ad3-47b5-476d-b91c-50c1b67c1c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:12.509848 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07854ad3-47b5-476d-b91c-50c1b67c1c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:12.510532 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07854ad3-47b5-476d-b91c-50c1b67c1c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:12.512465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07854ad3-47b5-476d-b91c-50c1b67c1c11 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:12.541364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1278/2575] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:35:12 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:35:12.545497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a5254-ccc6-493d-93ff-276c8e4ea1f9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:12.557094 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a5254-ccc6-493d-93ff-276c8e4ea1f9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:12.616215 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f5268-0ca9-46be-9903-1c01dd9ec77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:12.616924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f5268-0ca9-46be-9903-1c01dd9ec77f admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:12.617169 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f5268-0ca9-46be-9903-1c01dd9ec77f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:12.617476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f5268-0ca9-46be-9903-1c01dd9ec77f admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:12.618177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f5268-0ca9-46be-9903-1c01dd9ec77f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:12.620293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f5268-0ca9-46be-9903-1c01dd9ec77f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:12.642991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1298/2576] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:35:12 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:12.644171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07854ad3-47b5-476d-b91c-50c1b67c1c11 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:12.654608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07854ad3-47b5-476d-b91c-50c1b67c1c11 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:12.659692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495198a-73f8-4dd7-8204-918f16bc2f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:12.661122 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495198a-73f8-4dd7-8204-918f16bc2f99 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:12.661502 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495198a-73f8-4dd7-8204-918f16bc2f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:12.661834 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495198a-73f8-4dd7-8204-918f16bc2f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:12.662558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495198a-73f8-4dd7-8204-918f16bc2f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:12.664495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495198a-73f8-4dd7-8204-918f16bc2f99 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:12.677058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1279/2577] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:35:12.680946 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f5268-0ca9-46be-9903-1c01dd9ec77f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:12.691103 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f5268-0ca9-46be-9903-1c01dd9ec77f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:12.696565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a34094-a07d-4a82-b196-3295022b5484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:12.697305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a34094-a07d-4a82-b196-3295022b5484 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:12.697590 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a34094-a07d-4a82-b196-3295022b5484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:12.697898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a34094-a07d-4a82-b196-3295022b5484 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:12.698808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a34094-a07d-4a82-b196-3295022b5484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:12.700465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a34094-a07d-4a82-b196-3295022b5484 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:12.713553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1299/2578] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:12.717686 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495198a-73f8-4dd7-8204-918f16bc2f99 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:12.728723 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495198a-73f8-4dd7-8204-918f16bc2f99 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:12.733335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3518c7-a1cb-444a-afb3-1f20c870b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:12.734267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3518c7-a1cb-444a-afb3-1f20c870b6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:12.734597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3518c7-a1cb-444a-afb3-1f20c870b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:12.734853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3518c7-a1cb-444a-afb3-1f20c870b6a2 admin admin] PATH_INFO: `/v3/projects/d998345414e84cd98ace4a86cbc59561/users/52506eb32d2f49e7aa4d6585b77c1917/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:12.753050 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3518c7-a1cb-444a-afb3-1f20c870b6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d998345414e84cd98ace4a86cbc59561, user_id=52506eb32d2f49e7aa4d6585b77c1917, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:12.755729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3518c7-a1cb-444a-afb3-1f20c870b6a2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:12.768847 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1280/2579] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:12 2022] PUT /identity/v3/projects/d998345414e84cd98ace4a86cbc59561/users/52506eb32d2f49e7aa4d6585b77c1917/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:12.774580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d185b-c15b-4545-a778-0f76af067f5e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:12.774914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d185b-c15b-4545-a778-0f76af067f5e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:12.775275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d185b-c15b-4545-a778-0f76af067f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:12.794067 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2e7d185b-c15b-4545-a778-0f76af067f5e None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:12.795274 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2e7d185b-c15b-4545-a778-0f76af067f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:12.853089 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1300/2580] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:35:12.862596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3518c7-a1cb-444a-afb3-1f20c870b6a2 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:12.864610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0d3518c7-a1cb-444a-afb3-1f20c870b6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:12.919069 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3518c7-a1cb-444a-afb3-1f20c870b6a2 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:12.922714 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d84c2-bf18-4342-9672-c264bd4a3802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:12.923357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d84c2-bf18-4342-9672-c264bd4a3802 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:12.923643 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d84c2-bf18-4342-9672-c264bd4a3802 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:12.923915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d84c2-bf18-4342-9672-c264bd4a3802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:12.932716 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d84c2-bf18-4342-9672-c264bd4a3802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:12.934132 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d84c2-bf18-4342-9672-c264bd4a3802 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:12.943234 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1281/2581] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:13.791956 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548faa4-fa3e-4716-b12d-7f4d9f5ce133 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:13.792556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548faa4-fa3e-4716-b12d-7f4d9f5ce133 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:13.792556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b548faa4-fa3e-4716-b12d-7f4d9f5ce133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:13.817982 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b548faa4-fa3e-4716-b12d-7f4d9f5ce133 None None] MFA Rules not processed for user `52506eb32d2f49e7aa4d6585b77c1917`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:13.819226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b548faa4-fa3e-4716-b12d-7f4d9f5ce133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:13.882831 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1301/2582] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:13.892793 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d84c2-bf18-4342-9672-c264bd4a3802 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:13.894308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-456d84c2-bf18-4342-9672-c264bd4a3802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:13.955791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d84c2-bf18-4342-9672-c264bd4a3802 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:13.960655 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f0ed5-17fa-487b-b240-e97091022039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:13.961311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f0ed5-17fa-487b-b240-e97091022039 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:13.961592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f0ed5-17fa-487b-b240-e97091022039 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:13.961866 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f0ed5-17fa-487b-b240-e97091022039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:13.971332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f0ed5-17fa-487b-b240-e97091022039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:13.973475 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f0ed5-17fa-487b-b240-e97091022039 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:13.983210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1282/2583] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:14.250986 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548faa4-fa3e-4716-b12d-7f4d9f5ce133 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:14.252527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b548faa4-fa3e-4716-b12d-7f4d9f5ce133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:14.266211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b548faa4-fa3e-4716-b12d-7f4d9f5ce133 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:14.272296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546192-7707-4c02-bfe7-38da69139e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:14.273049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546192-7707-4c02-bfe7-38da69139e74 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:14.273328 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546192-7707-4c02-bfe7-38da69139e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:14.273765 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546192-7707-4c02-bfe7-38da69139e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:14.275827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2b546192-7707-4c02-bfe7-38da69139e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:14.288841 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b546192-7707-4c02-bfe7-38da69139e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:14.290529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b546192-7707-4c02-bfe7-38da69139e74 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:14.300339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1302/2584] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:35:15.330640 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5b606-08d9-47be-945c-f76aa4016a38 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:15.331291 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5b606-08d9-47be-945c-f76aa4016a38 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:15.331291 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5b606-08d9-47be-945c-f76aa4016a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:15.349947 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-9da5b606-08d9-47be-945c-f76aa4016a38 None None] MFA Rules not processed for user `52506eb32d2f49e7aa4d6585b77c1917`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:15.351701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9da5b606-08d9-47be-945c-f76aa4016a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:15.360196 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1283/2585] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:18.035956 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546192-7707-4c02-bfe7-38da69139e74 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:18.039017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2b546192-7707-4c02-bfe7-38da69139e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:18.051952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546192-7707-4c02-bfe7-38da69139e74 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:18.056649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc90db-b5b3-4d7c-999b-964c15465224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:18.057506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc90db-b5b3-4d7c-999b-964c15465224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:18.057784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc90db-b5b3-4d7c-999b-964c15465224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:18.058056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc90db-b5b3-4d7c-999b-964c15465224 admin admin] PATH_INFO: `/v3/users/53dc4402074b44deb42d688bc302a58c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:18.059381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc90db-b5b3-4d7c-999b-964c15465224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53dc4402074b44deb42d688bc302a58c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:18.061853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc90db-b5b3-4d7c-999b-964c15465224 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:18.108397 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-36cc90db-b5b3-4d7c-999b-964c15465224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53dc4402074b44deb42d688bc302a58c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:18.120537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-36cc90db-b5b3-4d7c-999b-964c15465224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53dc4402074b44deb42d688bc302a58c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:18.121537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-36cc90db-b5b3-4d7c-999b-964c15465224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53dc4402074b44deb42d688bc302a58c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:18.129144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-36cc90db-b5b3-4d7c-999b-964c15465224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53dc4402074b44deb42d688bc302a58c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:18.135948 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-36cc90db-b5b3-4d7c-999b-964c15465224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53dc4402074b44deb42d688bc302a58c'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:18.141838 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1303/2586] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:35:18 2022] DELETE /identity/v3/users/53dc4402074b44deb42d688bc302a58c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:18.318113 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5b606-08d9-47be-945c-f76aa4016a38 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:18.338416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5b606-08d9-47be-945c-f76aa4016a38 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:18.398162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c102765-be19-42b2-a019-30047ad7a11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:18.399087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c102765-be19-42b2-a019-30047ad7a11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:18.399365 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c102765-be19-42b2-a019-30047ad7a11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:18.399635 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c102765-be19-42b2-a019-30047ad7a11c admin admin] PATH_INFO: `/v3/projects/e5ffe873ea8e4496ae33e277307e3b5b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:18.400825 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c102765-be19-42b2-a019-30047ad7a11c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ffe873ea8e4496ae33e277307e3b5b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:18.402743 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c102765-be19-42b2-a019-30047ad7a11c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:18.448268 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1c102765-be19-42b2-a019-30047ad7a11c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ffe873ea8e4496ae33e277307e3b5b', 'request_id': 'req-1c102765-be19-42b2-a019-30047ad7a11c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:18.453952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1c102765-be19-42b2-a019-30047ad7a11c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ffe873ea8e4496ae33e277307e3b5b', 'request_id': 'req-1c102765-be19-42b2-a019-30047ad7a11c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:18.460670 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1c102765-be19-42b2-a019-30047ad7a11c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ffe873ea8e4496ae33e277307e3b5b', 'request_id': 'req-1c102765-be19-42b2-a019-30047ad7a11c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:18.474718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1c102765-be19-42b2-a019-30047ad7a11c admin admin] The token cache is being invalidate because project e5ffe873ea8e4496ae33e277307e3b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:35:18.475063 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1c102765-be19-42b2-a019-30047ad7a11c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:18.475638 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1c102765-be19-42b2-a019-30047ad7a11c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:18.477416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1284/2587] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:35:18 2022] DELETE /identity/v3/projects/e5ffe873ea8e4496ae33e277307e3b5b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:35:18.482522 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c9f8d-f561-4fcc-8655-ef2c2267d74d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:18.482920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c9f8d-f561-4fcc-8655-ef2c2267d74d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:18.483324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c9f8d-f561-4fcc-8655-ef2c2267d74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:18.501615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ad9c9f8d-f561-4fcc-8655-ef2c2267d74d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:18.502805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ad9c9f8d-f561-4fcc-8655-ef2c2267d74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:18.561352 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1304/2588] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:18.569547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21353f-eabe-4ac8-9ffb-83233370d92d None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:18.569830 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21353f-eabe-4ac8-9ffb-83233370d92d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:18.570128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21353f-eabe-4ac8-9ffb-83233370d92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:18.588569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-9b21353f-eabe-4ac8-9ffb-83233370d92d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:18.589928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9b21353f-eabe-4ac8-9ffb-83233370d92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:18.599023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1285/2589] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:18.604141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c9f8d-f561-4fcc-8655-ef2c2267d74d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:18.614528 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c9f8d-f561-4fcc-8655-ef2c2267d74d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:18.619444 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32e9da-c36e-444f-954e-5fe0d6a23649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:18.620219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32e9da-c36e-444f-954e-5fe0d6a23649 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:18.620594 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32e9da-c36e-444f-954e-5fe0d6a23649 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:18.620871 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32e9da-c36e-444f-954e-5fe0d6a23649 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:18.621593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32e9da-c36e-444f-954e-5fe0d6a23649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:35:18.621894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32e9da-c36e-444f-954e-5fe0d6a23649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:18.624018 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32e9da-c36e-444f-954e-5fe0d6a23649 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:18.639250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1305/2590] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:35:18.640483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21353f-eabe-4ac8-9ffb-83233370d92d None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:18.651106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21353f-eabe-4ac8-9ffb-83233370d92d None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:18.655889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c7ee8-7f23-4c20-ac28-35cf20902260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:18.656582 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c7ee8-7f23-4c20-ac28-35cf20902260 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:18.657038 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c7ee8-7f23-4c20-ac28-35cf20902260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:18.657500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c7ee8-7f23-4c20-ac28-35cf20902260 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:18.658200 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c7ee8-7f23-4c20-ac28-35cf20902260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:18.660656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c7ee8-7f23-4c20-ac28-35cf20902260 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:18.694962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1286/2591] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:35:18 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:18.699276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32e9da-c36e-444f-954e-5fe0d6a23649 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:18.710253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32e9da-c36e-444f-954e-5fe0d6a23649 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:18.766394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76976d6-d8d1-4f2f-bf57-9da0b3f41614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:18.767073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76976d6-d8d1-4f2f-bf57-9da0b3f41614 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:18.767427 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76976d6-d8d1-4f2f-bf57-9da0b3f41614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:18.767748 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76976d6-d8d1-4f2f-bf57-9da0b3f41614 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:18.768495 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76976d6-d8d1-4f2f-bf57-9da0b3f41614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:18.771122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76976d6-d8d1-4f2f-bf57-9da0b3f41614 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:18.794018 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1306/2592] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:35:18 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:35:18.797934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c7ee8-7f23-4c20-ac28-35cf20902260 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:18.808889 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c7ee8-7f23-4c20-ac28-35cf20902260 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:18.813808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57d1f9-6572-44f1-9c53-832299982675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:18.814409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57d1f9-6572-44f1-9c53-832299982675 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:18.814690 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57d1f9-6572-44f1-9c53-832299982675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:18.814965 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57d1f9-6572-44f1-9c53-832299982675 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:18.815679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57d1f9-6572-44f1-9c53-832299982675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:18.817855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57d1f9-6572-44f1-9c53-832299982675 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:18.829054 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1287/2593] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:18.833846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76976d6-d8d1-4f2f-bf57-9da0b3f41614 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:18.843500 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76976d6-d8d1-4f2f-bf57-9da0b3f41614 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:18.848907 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b52327-3e38-4e20-8ac1-048e534d7ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:18.849572 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b52327-3e38-4e20-8ac1-048e534d7ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:18.849854 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b52327-3e38-4e20-8ac1-048e534d7ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:18.850131 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b52327-3e38-4e20-8ac1-048e534d7ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:18.850881 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b52327-3e38-4e20-8ac1-048e534d7ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:18.852512 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b52327-3e38-4e20-8ac1-048e534d7ad1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:18.862489 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1307/2594] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:18.866702 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57d1f9-6572-44f1-9c53-832299982675 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:18.876996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57d1f9-6572-44f1-9c53-832299982675 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:18.882379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804da7d0-7838-4996-818e-ff2abf1c40dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:18.883264 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804da7d0-7838-4996-818e-ff2abf1c40dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:18.883542 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804da7d0-7838-4996-818e-ff2abf1c40dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:18.883990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804da7d0-7838-4996-818e-ff2abf1c40dd admin admin] PATH_INFO: `/v3/projects/537bfed4d21e402fa983ea95b2842c4e/users/59e5216679fc431d8d3de7414649aa7d/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:18.900620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804da7d0-7838-4996-818e-ff2abf1c40dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=537bfed4d21e402fa983ea95b2842c4e, user_id=59e5216679fc431d8d3de7414649aa7d, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:18.903728 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804da7d0-7838-4996-818e-ff2abf1c40dd admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:18.917853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1288/2595] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:18 2022] PUT /identity/v3/projects/537bfed4d21e402fa983ea95b2842c4e/users/59e5216679fc431d8d3de7414649aa7d/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:18.927809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cee17-1fe7-4064-8479-9d6379fd7606 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:18.928137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cee17-1fe7-4064-8479-9d6379fd7606 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:18.928415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cee17-1fe7-4064-8479-9d6379fd7606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:18.956404 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0b9cee17-1fe7-4064-8479-9d6379fd7606 None None] MFA Rules not processed for user `59e5216679fc431d8d3de7414649aa7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:18.958256 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0b9cee17-1fe7-4064-8479-9d6379fd7606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:19.029228 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1308/2596] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:19.041481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804da7d0-7838-4996-818e-ff2abf1c40dd admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:19.043169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-804da7d0-7838-4996-818e-ff2abf1c40dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:19.140751 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804da7d0-7838-4996-818e-ff2abf1c40dd admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:19.147209 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aae243-2f9e-429b-9b53-8ba532a25c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:19.147861 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aae243-2f9e-429b-9b53-8ba532a25c04 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:19.148195 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aae243-2f9e-429b-9b53-8ba532a25c04 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:19.148478 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aae243-2f9e-429b-9b53-8ba532a25c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:19.156923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aae243-2f9e-429b-9b53-8ba532a25c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:19.158604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aae243-2f9e-429b-9b53-8ba532a25c04 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:19.168483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1289/2597] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:19.358759 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cee17-1fe7-4064-8479-9d6379fd7606 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:19.427079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cee17-1fe7-4064-8479-9d6379fd7606 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:19.432306 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:19.433177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:19.433458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:19.433731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] PATH_INFO: `/v3/users/59e5216679fc431d8d3de7414649aa7d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:19.434918 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e5216679fc431d8d3de7414649aa7d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:19.436911 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:19.490298 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e5216679fc431d8d3de7414649aa7d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:19.503401 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e5216679fc431d8d3de7414649aa7d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:19.504494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e5216679fc431d8d3de7414649aa7d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:19.511781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e5216679fc431d8d3de7414649aa7d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:19.518947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e5216679fc431d8d3de7414649aa7d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:19.525701 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1309/2598] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:35:19 2022] DELETE /identity/v3/users/59e5216679fc431d8d3de7414649aa7d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:19.530640 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025b9c-31a2-4394-aec1-65cf1d11b739 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:19.531125 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025b9c-31a2-4394-aec1-65cf1d11b739 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:19.531232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66025b9c-31a2-4394-aec1-65cf1d11b739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:19.552264 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-66025b9c-31a2-4394-aec1-65cf1d11b739 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:19.553766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-66025b9c-31a2-4394-aec1-65cf1d11b739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:19.620459 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1290/2599] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:19.665998 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:19.667629 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:19.727575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fc70e-6212-418a-b9fb-caa17f455be8 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:19.731272 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8e128-d7e0-4367-94e8-68b9f6747ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:19.731921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8e128-d7e0-4367-94e8-68b9f6747ffb service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:19.732227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8e128-d7e0-4367-94e8-68b9f6747ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:19.732501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8e128-d7e0-4367-94e8-68b9f6747ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:19.742953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8e128-d7e0-4367-94e8-68b9f6747ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:19.744438 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8e128-d7e0-4367-94e8-68b9f6747ffb service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:19.754661 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1310/2600] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:35:20.188951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025b9c-31a2-4394-aec1-65cf1d11b739 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:20.190392 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-66025b9c-31a2-4394-aec1-65cf1d11b739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:20.204782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66025b9c-31a2-4394-aec1-65cf1d11b739 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:20.209663 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5147a7c-addc-44d0-98d9-5a16427058e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:20.210528 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147a7c-addc-44d0-98d9-5a16427058e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:20.210859 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147a7c-addc-44d0-98d9-5a16427058e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:20.211545 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147a7c-addc-44d0-98d9-5a16427058e8 admin admin] PATH_INFO: `/v3/projects/537bfed4d21e402fa983ea95b2842c4e` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:20.212843 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5147a7c-addc-44d0-98d9-5a16427058e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537bfed4d21e402fa983ea95b2842c4e)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:20.215492 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5147a7c-addc-44d0-98d9-5a16427058e8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:20.261818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f5147a7c-addc-44d0-98d9-5a16427058e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537bfed4d21e402fa983ea95b2842c4e', 'request_id': 'req-f5147a7c-addc-44d0-98d9-5a16427058e8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:20.267116 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f5147a7c-addc-44d0-98d9-5a16427058e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537bfed4d21e402fa983ea95b2842c4e', 'request_id': 'req-f5147a7c-addc-44d0-98d9-5a16427058e8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:20.273247 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f5147a7c-addc-44d0-98d9-5a16427058e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537bfed4d21e402fa983ea95b2842c4e', 'request_id': 'req-f5147a7c-addc-44d0-98d9-5a16427058e8'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:20.285231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f5147a7c-addc-44d0-98d9-5a16427058e8 admin admin] The token cache is being invalidate because project 537bfed4d21e402fa983ea95b2842c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:35:20.285483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f5147a7c-addc-44d0-98d9-5a16427058e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:20.286125 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f5147a7c-addc-44d0-98d9-5a16427058e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:20.287631 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1291/2601] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:35:20 2022] DELETE /identity/v3/projects/537bfed4d21e402fa983ea95b2842c4e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:20.292894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b2ac-9dd1-475a-b1c4-7d54547dd163 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:20.293186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b2ac-9dd1-475a-b1c4-7d54547dd163 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:20.293460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b2ac-9dd1-475a-b1c4-7d54547dd163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:20.311082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-71b7b2ac-9dd1-475a-b1c4-7d54547dd163 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:20.312354 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-71b7b2ac-9dd1-475a-b1c4-7d54547dd163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:20.367773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1311/2602] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:35:20.375405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ad5f1-7e45-4ce4-9a82-d3d13f4b6343 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:20.375693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ad5f1-7e45-4ce4-9a82-d3d13f4b6343 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:20.375972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ad5f1-7e45-4ce4-9a82-d3d13f4b6343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:20.395625 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-3b1ad5f1-7e45-4ce4-9a82-d3d13f4b6343 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:20.396867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-3b1ad5f1-7e45-4ce4-9a82-d3d13f4b6343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:20.404961 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1292/2603] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:20.408973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7b2ac-9dd1-475a-b1c4-7d54547dd163 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:20.425339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7b2ac-9dd1-475a-b1c4-7d54547dd163 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:20.431167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d848d8-b012-42ae-804b-0894d1a6934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:20.432352 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d848d8-b012-42ae-804b-0894d1a6934f admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:20.432846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d848d8-b012-42ae-804b-0894d1a6934f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:20.433330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d848d8-b012-42ae-804b-0894d1a6934f admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:20.434651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d848d8-b012-42ae-804b-0894d1a6934f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:35:20.435188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d848d8-b012-42ae-804b-0894d1a6934f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:20.437923 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d848d8-b012-42ae-804b-0894d1a6934f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:20.450645 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1312/2604] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:35:20.455168 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ad5f1-7e45-4ce4-9a82-d3d13f4b6343 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:20.466495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ad5f1-7e45-4ce4-9a82-d3d13f4b6343 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:20.471576 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8e5c7-a933-4184-bc90-2e732852c1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:20.472259 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8e5c7-a933-4184-bc90-2e732852c1bb admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:20.472788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8e5c7-a933-4184-bc90-2e732852c1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:20.473283 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8e5c7-a933-4184-bc90-2e732852c1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:20.473998 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8e5c7-a933-4184-bc90-2e732852c1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:20.475881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8e5c7-a933-4184-bc90-2e732852c1bb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:20.500660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1293/2605] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:35:20 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:20.505401 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d848d8-b012-42ae-804b-0894d1a6934f admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:20.515159 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d848d8-b012-42ae-804b-0894d1a6934f admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:20.570799 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b2bc9-b89f-430f-9c9d-c9fdf287245c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:20.571471 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b2bc9-b89f-430f-9c9d-c9fdf287245c admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:20.571745 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b2bc9-b89f-430f-9c9d-c9fdf287245c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:20.572017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b2bc9-b89f-430f-9c9d-c9fdf287245c admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:20.572743 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b2bc9-b89f-430f-9c9d-c9fdf287245c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:20.574655 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b2bc9-b89f-430f-9c9d-c9fdf287245c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:20.596974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1313/2606] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:35:20 2022] POST /identity/v3/users => generated 302 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:35:20.598795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8e5c7-a933-4184-bc90-2e732852c1bb admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:20.609519 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8e5c7-a933-4184-bc90-2e732852c1bb admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:20.615182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23915aa1-15ed-437a-9bb1-de7870068b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:20.615831 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23915aa1-15ed-437a-9bb1-de7870068b08 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:20.616148 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23915aa1-15ed-437a-9bb1-de7870068b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:20.616424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23915aa1-15ed-437a-9bb1-de7870068b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:20.617136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23915aa1-15ed-437a-9bb1-de7870068b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:20.618712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23915aa1-15ed-437a-9bb1-de7870068b08 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:20.628789 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1294/2607] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:20.632881 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b2bc9-b89f-430f-9c9d-c9fdf287245c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:20.642572 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b2bc9-b89f-430f-9c9d-c9fdf287245c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:20.647260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed22cb-a023-48c7-af67-890adfbc5c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:20.647905 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed22cb-a023-48c7-af67-890adfbc5c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:20.648243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed22cb-a023-48c7-af67-890adfbc5c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:20.648521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed22cb-a023-48c7-af67-890adfbc5c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:20.649235 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed22cb-a023-48c7-af67-890adfbc5c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:20.650935 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed22cb-a023-48c7-af67-890adfbc5c2b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:20.661343 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1314/2608] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:20.665608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23915aa1-15ed-437a-9bb1-de7870068b08 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:20.675142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23915aa1-15ed-437a-9bb1-de7870068b08 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:20.680890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a47ff-b060-4dc8-8366-cc849c04deac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:20.681772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a47ff-b060-4dc8-8366-cc849c04deac admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:20.682052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a47ff-b060-4dc8-8366-cc849c04deac admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:20.682324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a47ff-b060-4dc8-8366-cc849c04deac admin admin] PATH_INFO: `/v3/projects/e07f6afa288f4088a131af7216e9b8ea/users/248ab25125dc4a059beeacff1c8c72c6/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:20.696679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a47ff-b060-4dc8-8366-cc849c04deac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07f6afa288f4088a131af7216e9b8ea, user_id=248ab25125dc4a059beeacff1c8c72c6, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:20.699796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a47ff-b060-4dc8-8366-cc849c04deac admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:20.712388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1295/2609] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:20 2022] PUT /identity/v3/projects/e07f6afa288f4088a131af7216e9b8ea/users/248ab25125dc4a059beeacff1c8c72c6/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:35:20.724477 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80eb48-68f0-458a-a47a-8cc5d466b7ea None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:20.724770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80eb48-68f0-458a-a47a-8cc5d466b7ea None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:20.725080 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80eb48-68f0-458a-a47a-8cc5d466b7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:20.751186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-8c80eb48-68f0-458a-a47a-8cc5d466b7ea None None] MFA Rules not processed for user `248ab25125dc4a059beeacff1c8c72c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:20.752422 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8c80eb48-68f0-458a-a47a-8cc5d466b7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:20.814947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1315/2610] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:20.819479 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a47ff-b060-4dc8-8366-cc849c04deac admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:20.878122 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a47ff-b060-4dc8-8366-cc849c04deac admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:20.883076 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd4ddb-7aeb-475c-b4a7-548842be386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:20.883728 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd4ddb-7aeb-475c-b4a7-548842be386c admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:20.884013 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd4ddb-7aeb-475c-b4a7-548842be386c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:20.884323 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd4ddb-7aeb-475c-b4a7-548842be386c admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:20.885020 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd4ddb-7aeb-475c-b4a7-548842be386c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:20.886941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd4ddb-7aeb-475c-b4a7-548842be386c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:20.914800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1296/2611] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:35:20 2022] POST /identity/v3/projects => generated 405 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:20.916901 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80eb48-68f0-458a-a47a-8cc5d466b7ea None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:20.927762 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80eb48-68f0-458a-a47a-8cc5d466b7ea None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:20.980394 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1715-c9c9-4f8c-ba44-350fb52b1be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:20.981046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1715-c9c9-4f8c-ba44-350fb52b1be6 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:20.981326 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1715-c9c9-4f8c-ba44-350fb52b1be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:20.981596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1715-c9c9-4f8c-ba44-350fb52b1be6 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:20.982270 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c1715-c9c9-4f8c-ba44-350fb52b1be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:20.984345 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c1715-c9c9-4f8c-ba44-350fb52b1be6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:21.003171 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1316/2612] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:35:20 2022] POST /identity/v3/users => generated 309 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:21.007253 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd4ddb-7aeb-475c-b4a7-548842be386c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:21.017772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd4ddb-7aeb-475c-b4a7-548842be386c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:21.023106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574e234-232b-439e-aada-bfddc3e433da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:21.023749 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574e234-232b-439e-aada-bfddc3e433da admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:21.024047 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574e234-232b-439e-aada-bfddc3e433da admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:21.024326 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574e234-232b-439e-aada-bfddc3e433da admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:21.025032 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574e234-232b-439e-aada-bfddc3e433da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:21.026611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574e234-232b-439e-aada-bfddc3e433da admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:21.038025 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1297/2613] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:21.042504 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1715-c9c9-4f8c-ba44-350fb52b1be6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:21.052413 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1715-c9c9-4f8c-ba44-350fb52b1be6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:21.056939 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c3e7d-4b81-4877-a37f-00063fb87ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:21.057796 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c3e7d-4b81-4877-a37f-00063fb87ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:21.058070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c3e7d-4b81-4877-a37f-00063fb87ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:21.058338 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c3e7d-4b81-4877-a37f-00063fb87ddf admin admin] PATH_INFO: `/v3/projects/182ebb3796724348ba244abdce98c85c/users/f067d9a0fe76497199a7cb275f973b4b/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:21.072350 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c3e7d-4b81-4877-a37f-00063fb87ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=182ebb3796724348ba244abdce98c85c, user_id=f067d9a0fe76497199a7cb275f973b4b, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:21.075175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c3e7d-4b81-4877-a37f-00063fb87ddf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:21.089639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1317/2614] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:21 2022] PUT /identity/v3/projects/182ebb3796724348ba244abdce98c85c/users/f067d9a0fe76497199a7cb275f973b4b/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:35:21.093592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574e234-232b-439e-aada-bfddc3e433da admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:21.104185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574e234-232b-439e-aada-bfddc3e433da admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:21.163717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22d7ef-aef0-42d5-9799-c44eb728ccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:21.164902 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22d7ef-aef0-42d5-9799-c44eb728ccfa admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:21.165107 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22d7ef-aef0-42d5-9799-c44eb728ccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:21.165383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22d7ef-aef0-42d5-9799-c44eb728ccfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:21.166099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22d7ef-aef0-42d5-9799-c44eb728ccfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:21.167685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22d7ef-aef0-42d5-9799-c44eb728ccfa admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:21.179596 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1298/2615] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:21.183689 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c3e7d-4b81-4877-a37f-00063fb87ddf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:21.194535 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c3e7d-4b81-4877-a37f-00063fb87ddf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:21.199403 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a1b93-fd2b-4ebc-abf4-541b19d3fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:21.200413 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a1b93-fd2b-4ebc-abf4-541b19d3fac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:21.200792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a1b93-fd2b-4ebc-abf4-541b19d3fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:21.201141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a1b93-fd2b-4ebc-abf4-541b19d3fac9 admin admin] PATH_INFO: `/v3/projects/182ebb3796724348ba244abdce98c85c/users/f067d9a0fe76497199a7cb275f973b4b/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:21.203267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a1b93-fd2b-4ebc-abf4-541b19d3fac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=182ebb3796724348ba244abdce98c85c, user_id=f067d9a0fe76497199a7cb275f973b4b, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:21.206015 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a1b93-fd2b-4ebc-abf4-541b19d3fac9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:21.218278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1318/2616] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:21 2022] PUT /identity/v3/projects/182ebb3796724348ba244abdce98c85c/users/f067d9a0fe76497199a7cb275f973b4b/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:21.229515 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43d3ea-602f-4a31-8bd5-aa0e565f92b0 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:21.230241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43d3ea-602f-4a31-8bd5-aa0e565f92b0 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:21.230241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43d3ea-602f-4a31-8bd5-aa0e565f92b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:21.259413 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-2d43d3ea-602f-4a31-8bd5-aa0e565f92b0 None None] MFA Rules not processed for user `f067d9a0fe76497199a7cb275f973b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:21.261039 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2d43d3ea-602f-4a31-8bd5-aa0e565f92b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:21.358399 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1299/2617] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:21 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:21.368289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a1b93-fd2b-4ebc-abf4-541b19d3fac9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:21.370111 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-397a1b93-fd2b-4ebc-abf4-541b19d3fac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:21.428626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a1b93-fd2b-4ebc-abf4-541b19d3fac9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:21.432308 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0d375-fe7c-4ac3-a3bd-8151834c07ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:21.432940 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0d375-fe7c-4ac3-a3bd-8151834c07ce service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:21.433217 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0d375-fe7c-4ac3-a3bd-8151834c07ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:21.433485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0d375-fe7c-4ac3-a3bd-8151834c07ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:21.443542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0d375-fe7c-4ac3-a3bd-8151834c07ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:21.445186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0d375-fe7c-4ac3-a3bd-8151834c07ce service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:21.456179 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1319/2618] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:21 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:21.506624 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43d3ea-602f-4a31-8bd5-aa0e565f92b0 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:21.508122 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2d43d3ea-602f-4a31-8bd5-aa0e565f92b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:21.587316 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43d3ea-602f-4a31-8bd5-aa0e565f92b0 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:21.593404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6238-e88f-4c9c-807a-c0ead5064fb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d870fbd90cb4fde9ceafd2b737795eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:21.594077 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6238-e88f-4c9c-807a-c0ead5064fb1 service placement] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:21.594356 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6238-e88f-4c9c-807a-c0ead5064fb1 service placement] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:21.594629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6238-e88f-4c9c-807a-c0ead5064fb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:21.598098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0d375-fe7c-4ac3-a3bd-8151834c07ce service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:21.598821 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-64ab6238-e88f-4c9c-807a-c0ead5064fb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:21.610032 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab6238-e88f-4c9c-807a-c0ead5064fb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:21.611641 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab6238-e88f-4c9c-807a-c0ead5064fb1 service placement] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:21.622170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1300/2619] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:35:21.659897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0d375-fe7c-4ac3-a3bd-8151834c07ce service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:21.665509 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:21.666457 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:21.666817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:21.667548 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] PATH_INFO: `/v3/users/248ab25125dc4a059beeacff1c8c72c6` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:21.668497 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=248ab25125dc4a059beeacff1c8c72c6)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:21.671065 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:21.725633 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248ab25125dc4a059beeacff1c8c72c6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:21.739851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248ab25125dc4a059beeacff1c8c72c6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:21.740914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248ab25125dc4a059beeacff1c8c72c6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:21.748596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248ab25125dc4a059beeacff1c8c72c6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:21.755995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248ab25125dc4a059beeacff1c8c72c6'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:21.762344 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1320/2620] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:35:21 2022] DELETE /identity/v3/users/248ab25125dc4a059beeacff1c8c72c6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:35:21.766632 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e183f-1769-4bea-a0d3-26df021cead9 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:21.766925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e183f-1769-4bea-a0d3-26df021cead9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:21.767202 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e183f-1769-4bea-a0d3-26df021cead9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:21.787235 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-234e183f-1769-4bea-a0d3-26df021cead9 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:21.788463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-234e183f-1769-4bea-a0d3-26df021cead9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:21.849607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1301/2621] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:21.860095 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:21.861520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:21.917321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a72688-8c32-4df3-b424-c94a35b15cd4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:21.921143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79312ad-08a2-4424-bb4d-410c866fd311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:21.921769 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79312ad-08a2-4424-bb4d-410c866fd311 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:21.922046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79312ad-08a2-4424-bb4d-410c866fd311 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:21.922340 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79312ad-08a2-4424-bb4d-410c866fd311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:21.931273 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79312ad-08a2-4424-bb4d-410c866fd311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:21.932730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79312ad-08a2-4424-bb4d-410c866fd311 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:21.941813 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1321/2622] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:22.203744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e183f-1769-4bea-a0d3-26df021cead9 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:22.205456 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-234e183f-1769-4bea-a0d3-26df021cead9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:22.220051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e183f-1769-4bea-a0d3-26df021cead9 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:22.225351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:22.226210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:22.226488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:22.226908 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] PATH_INFO: `/v3/projects/e07f6afa288f4088a131af7216e9b8ea` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:22.228100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07f6afa288f4088a131af7216e9b8ea)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:22.229996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:22.275651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07f6afa288f4088a131af7216e9b8ea', 'request_id': 'req-14c817e9-45db-4d0e-ae77-758aaa9e2b92'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.280739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07f6afa288f4088a131af7216e9b8ea', 'request_id': 'req-14c817e9-45db-4d0e-ae77-758aaa9e2b92'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.286688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07f6afa288f4088a131af7216e9b8ea', 'request_id': 'req-14c817e9-45db-4d0e-ae77-758aaa9e2b92'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.298423 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] The token cache is being invalidate because project e07f6afa288f4088a131af7216e9b8ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:35:22.298710 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.299330 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.300938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1302/2623] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:35:22 2022] DELETE /identity/v3/projects/e07f6afa288f4088a131af7216e9b8ea => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:22.304882 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79312ad-08a2-4424-bb4d-410c866fd311 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:22.314097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79312ad-08a2-4424-bb4d-410c866fd311 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:22.370108 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eb922-2dd0-444e-a8bc-3469f2b732b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:22.370971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb922-2dd0-444e-a8bc-3469f2b732b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:22.371258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb922-2dd0-444e-a8bc-3469f2b732b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:22.371533 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eb922-2dd0-444e-a8bc-3469f2b732b6 admin admin] PATH_INFO: `/v3/users/f067d9a0fe76497199a7cb275f973b4b` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:22.372737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eb922-2dd0-444e-a8bc-3469f2b732b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f067d9a0fe76497199a7cb275f973b4b)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:22.374638 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eb922-2dd0-444e-a8bc-3469f2b732b6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:22.422825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-972eb922-2dd0-444e-a8bc-3469f2b732b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f067d9a0fe76497199a7cb275f973b4b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.434761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-972eb922-2dd0-444e-a8bc-3469f2b732b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f067d9a0fe76497199a7cb275f973b4b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.435449 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-972eb922-2dd0-444e-a8bc-3469f2b732b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f067d9a0fe76497199a7cb275f973b4b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.443211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-972eb922-2dd0-444e-a8bc-3469f2b732b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f067d9a0fe76497199a7cb275f973b4b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.450297 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-972eb922-2dd0-444e-a8bc-3469f2b732b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f067d9a0fe76497199a7cb275f973b4b'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.459485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1322/2624] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:35:22 2022] DELETE /identity/v3/users/f067d9a0fe76497199a7cb275f973b4b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:35:22.758647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:22.760199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:22.773076 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c817e9-45db-4d0e-ae77-758aaa9e2b92 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:22.830242 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:22.831089 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:22.831369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:22.831650 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41 admin admin] PATH_INFO: `/v3/projects/182ebb3796724348ba244abdce98c85c` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:22.833257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=182ebb3796724348ba244abdce98c85c)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:22.835179 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:22.879311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182ebb3796724348ba244abdce98c85c', 'request_id': 'req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.884318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182ebb3796724348ba244abdce98c85c', 'request_id': 'req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.890617 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182ebb3796724348ba244abdce98c85c', 'request_id': 'req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.902717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41 admin admin] The token cache is being invalidate because project 182ebb3796724348ba244abdce98c85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:35:22.902999 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.903607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3e7c3f97-f365-4f0f-b14a-7cb31717bb41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:22.905288 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1303/2625] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:35:22 2022] DELETE /identity/v3/projects/182ebb3796724348ba244abdce98c85c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:22.911279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72000e-86bc-4226-8c59-6f8c3e503a8b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:22.911575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72000e-86bc-4226-8c59-6f8c3e503a8b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:22.911882 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72000e-86bc-4226-8c59-6f8c3e503a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:22.930109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-de72000e-86bc-4226-8c59-6f8c3e503a8b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:22.931297 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-de72000e-86bc-4226-8c59-6f8c3e503a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:22.986974 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1323/2626] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:35:22.997401 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae75bd-d8c2-474d-adfd-7582a2278d77 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:22.997687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae75bd-d8c2-474d-adfd-7582a2278d77 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:22.997964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae75bd-d8c2-474d-adfd-7582a2278d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.015914 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-dcae75bd-d8c2-474d-adfd-7582a2278d77 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:23.017141 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-dcae75bd-d8c2-474d-adfd-7582a2278d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:23.025171 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1304/2627] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:23.029601 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72000e-86bc-4226-8c59-6f8c3e503a8b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.040146 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72000e-86bc-4226-8c59-6f8c3e503a8b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:23.044710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39738ed-57d1-48cd-a6e5-42ca6b0ed559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:23.045366 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39738ed-57d1-48cd-a6e5-42ca6b0ed559 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.045653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39738ed-57d1-48cd-a6e5-42ca6b0ed559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.045932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39738ed-57d1-48cd-a6e5-42ca6b0ed559 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.046892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39738ed-57d1-48cd-a6e5-42ca6b0ed559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:35:23.047207 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39738ed-57d1-48cd-a6e5-42ca6b0ed559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:23.048837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39738ed-57d1-48cd-a6e5-42ca6b0ed559 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:23.060810 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1324/2628] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:35:23.065088 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae75bd-d8c2-474d-adfd-7582a2278d77 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.074214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae75bd-d8c2-474d-adfd-7582a2278d77 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:23.078800 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fb2cc-87c1-460d-87e3-58632655c78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:23.079435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fb2cc-87c1-460d-87e3-58632655c78b admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.079715 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fb2cc-87c1-460d-87e3-58632655c78b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.079991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fb2cc-87c1-460d-87e3-58632655c78b admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.080693 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fb2cc-87c1-460d-87e3-58632655c78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:23.082638 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fb2cc-87c1-460d-87e3-58632655c78b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:23.109191 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1305/2629] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:35:23 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:35:23.113815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39738ed-57d1-48cd-a6e5-42ca6b0ed559 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.124482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39738ed-57d1-48cd-a6e5-42ca6b0ed559 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:23.182892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978990d3-8299-4a8d-ab4c-42f489a93382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:23.183554 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978990d3-8299-4a8d-ab4c-42f489a93382 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.183830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978990d3-8299-4a8d-ab4c-42f489a93382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.184150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978990d3-8299-4a8d-ab4c-42f489a93382 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.184822 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978990d3-8299-4a8d-ab4c-42f489a93382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:23.186808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978990d3-8299-4a8d-ab4c-42f489a93382 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:23.206250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1325/2630] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:35:23 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:35:23.210957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fb2cc-87c1-460d-87e3-58632655c78b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.223482 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fb2cc-87c1-460d-87e3-58632655c78b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:23.228450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946366cd-7a37-4282-84ff-ac4ccb538443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:23.229106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946366cd-7a37-4282-84ff-ac4ccb538443 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.229385 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946366cd-7a37-4282-84ff-ac4ccb538443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.229660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946366cd-7a37-4282-84ff-ac4ccb538443 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.230379 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946366cd-7a37-4282-84ff-ac4ccb538443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:23.231965 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946366cd-7a37-4282-84ff-ac4ccb538443 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:23.242631 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1306/2631] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:23.246610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978990d3-8299-4a8d-ab4c-42f489a93382 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.257117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978990d3-8299-4a8d-ab4c-42f489a93382 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:23.261947 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8aaab-4770-412b-9e88-f03f19020d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:23.262598 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8aaab-4770-412b-9e88-f03f19020d0b admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.262904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8aaab-4770-412b-9e88-f03f19020d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.263170 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8aaab-4770-412b-9e88-f03f19020d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.263890 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8aaab-4770-412b-9e88-f03f19020d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:23.265500 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8aaab-4770-412b-9e88-f03f19020d0b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:23.276117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1326/2632] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:23.280136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946366cd-7a37-4282-84ff-ac4ccb538443 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.291086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946366cd-7a37-4282-84ff-ac4ccb538443 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:23.296086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ccf7-55da-46f4-9571-7a17614a3f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:23.296951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ccf7-55da-46f4-9571-7a17614a3f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.297224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ccf7-55da-46f4-9571-7a17614a3f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.297491 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ccf7-55da-46f4-9571-7a17614a3f6b admin admin] PATH_INFO: `/v3/projects/bcfa7e4e93aa4656ba95ce92f336af66/users/5c82597a369b4035a033cc1372ac51e2/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.312296 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85ccf7-55da-46f4-9571-7a17614a3f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfa7e4e93aa4656ba95ce92f336af66, user_id=5c82597a369b4035a033cc1372ac51e2, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:23.315059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85ccf7-55da-46f4-9571-7a17614a3f6b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:23.327784 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1307/2633] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:23 2022] PUT /identity/v3/projects/bcfa7e4e93aa4656ba95ce92f336af66/users/5c82597a369b4035a033cc1372ac51e2/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:23.338625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724df8e-ac56-42d9-a3cd-4dae5576fe98 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.339176 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724df8e-ac56-42d9-a3cd-4dae5576fe98 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.339652 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724df8e-ac56-42d9-a3cd-4dae5576fe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.372624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-2724df8e-ac56-42d9-a3cd-4dae5576fe98 None None] MFA Rules not processed for user `5c82597a369b4035a033cc1372ac51e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:23.373863 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2724df8e-ac56-42d9-a3cd-4dae5576fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:23.443791 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1327/2634] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:23.447069 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ccf7-55da-46f4-9571-7a17614a3f6b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.510009 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ccf7-55da-46f4-9571-7a17614a3f6b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:23.514672 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80ebd5-44b3-49e8-9193-b4a7a684b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:23.515325 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80ebd5-44b3-49e8-9193-b4a7a684b20c admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.515606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80ebd5-44b3-49e8-9193-b4a7a684b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.515881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80ebd5-44b3-49e8-9193-b4a7a684b20c admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.516718 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80ebd5-44b3-49e8-9193-b4a7a684b20c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:23.518619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80ebd5-44b3-49e8-9193-b4a7a684b20c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:23.545638 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1308/2635] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:35:23 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:23.549785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724df8e-ac56-42d9-a3cd-4dae5576fe98 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.560792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724df8e-ac56-42d9-a3cd-4dae5576fe98 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:23.627281 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e81621-1278-4158-b536-6f8df61bd3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:23.627957 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e81621-1278-4158-b536-6f8df61bd3cf admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.628267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e81621-1278-4158-b536-6f8df61bd3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.628542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e81621-1278-4158-b536-6f8df61bd3cf admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.629918 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e81621-1278-4158-b536-6f8df61bd3cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:23.632194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e81621-1278-4158-b536-6f8df61bd3cf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:23.652945 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1328/2636] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:35:23 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:35:23.657114 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80ebd5-44b3-49e8-9193-b4a7a684b20c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.667592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80ebd5-44b3-49e8-9193-b4a7a684b20c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:23.673036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dd527-e6a2-4627-ab48-cb200796a25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:23.673694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dd527-e6a2-4627-ab48-cb200796a25d admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.673979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dd527-e6a2-4627-ab48-cb200796a25d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.674256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dd527-e6a2-4627-ab48-cb200796a25d admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.674974 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86dd527-e6a2-4627-ab48-cb200796a25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:23.676748 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86dd527-e6a2-4627-ab48-cb200796a25d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:23.687712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1309/2637] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:35:23.692307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e81621-1278-4158-b536-6f8df61bd3cf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.702066 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e81621-1278-4158-b536-6f8df61bd3cf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:23.707696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0148fe-478e-435b-95a1-68137fc36341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:23.708648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0148fe-478e-435b-95a1-68137fc36341 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.708927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0148fe-478e-435b-95a1-68137fc36341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.709198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0148fe-478e-435b-95a1-68137fc36341 admin admin] PATH_INFO: `/v3/projects/b8c136a291d44f7583defb3636722d95/users/827872c212f14b169102521f7d2afab5/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.723871 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0148fe-478e-435b-95a1-68137fc36341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c136a291d44f7583defb3636722d95, user_id=827872c212f14b169102521f7d2afab5, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:23.726584 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0148fe-478e-435b-95a1-68137fc36341 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:23.739498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1329/2638] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:23 2022] PUT /identity/v3/projects/b8c136a291d44f7583defb3636722d95/users/827872c212f14b169102521f7d2afab5/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:23.743468 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dd527-e6a2-4627-ab48-cb200796a25d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.753333 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dd527-e6a2-4627-ab48-cb200796a25d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:23.808134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa388c9a-99cf-440a-b1a3-4801d23c4422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:23.808790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388c9a-99cf-440a-b1a3-4801d23c4422 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.808992 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388c9a-99cf-440a-b1a3-4801d23c4422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.809258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa388c9a-99cf-440a-b1a3-4801d23c4422 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.809993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa388c9a-99cf-440a-b1a3-4801d23c4422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:23.811640 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa388c9a-99cf-440a-b1a3-4801d23c4422 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:23.821838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1310/2639] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:23.826049 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0148fe-478e-435b-95a1-68137fc36341 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.836460 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0148fe-478e-435b-95a1-68137fc36341 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:23.841188 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39e41-6939-4753-9adb-40e5529298c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:23.842048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39e41-6939-4753-9adb-40e5529298c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.842317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39e41-6939-4753-9adb-40e5529298c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.842580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f39e41-6939-4753-9adb-40e5529298c7 admin admin] PATH_INFO: `/v3/projects/b8c136a291d44f7583defb3636722d95/users/827872c212f14b169102521f7d2afab5/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.844516 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39e41-6939-4753-9adb-40e5529298c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c136a291d44f7583defb3636722d95, user_id=827872c212f14b169102521f7d2afab5, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:23.847094 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f39e41-6939-4753-9adb-40e5529298c7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:23.856992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1330/2640] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:23 2022] PUT /identity/v3/projects/b8c136a291d44f7583defb3636722d95/users/827872c212f14b169102521f7d2afab5/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:23.866869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400feb5a-a743-41bb-badb-cd61014342ce None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:23.867162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400feb5a-a743-41bb-badb-cd61014342ce None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:23.867469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400feb5a-a743-41bb-badb-cd61014342ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:23.893102 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-400feb5a-a743-41bb-badb-cd61014342ce None None] MFA Rules not processed for user `827872c212f14b169102521f7d2afab5`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:23.894292 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-400feb5a-a743-41bb-badb-cd61014342ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:23.959746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1311/2641] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:23.970106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39e41-6939-4753-9adb-40e5529298c7 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:23.971772 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-86f39e41-6939-4753-9adb-40e5529298c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:24.026546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f39e41-6939-4753-9adb-40e5529298c7 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:24.030156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad2909-3d77-49ed-8d35-2330bc4a4e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:24.030795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2909-3d77-49ed-8d35-2330bc4a4e51 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:24.031073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2909-3d77-49ed-8d35-2330bc4a4e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:24.031341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2909-3d77-49ed-8d35-2330bc4a4e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:24.041060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad2909-3d77-49ed-8d35-2330bc4a4e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:24.042480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad2909-3d77-49ed-8d35-2330bc4a4e51 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:24.052254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1331/2642] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:24.120374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400feb5a-a743-41bb-badb-cd61014342ce None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:24.130248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400feb5a-a743-41bb-badb-cd61014342ce None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:24.133847 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168540d-3fb8-44f5-b0c8-37ac4ab45736 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:24.134472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168540d-3fb8-44f5-b0c8-37ac4ab45736 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:24.134770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168540d-3fb8-44f5-b0c8-37ac4ab45736 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:24.135030 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168540d-3fb8-44f5-b0c8-37ac4ab45736 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:24.189218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168540d-3fb8-44f5-b0c8-37ac4ab45736 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:24.190648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168540d-3fb8-44f5-b0c8-37ac4ab45736 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:24.200198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1312/2643] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:34.300828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad2909-3d77-49ed-8d35-2330bc4a4e51 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:34.363659 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad2909-3d77-49ed-8d35-2330bc4a4e51 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:34.368424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:34.369578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:34.370078 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:34.370580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] PATH_INFO: `/v3/users/5c82597a369b4035a033cc1372ac51e2` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:34.371909 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c82597a369b4035a033cc1372ac51e2)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:34.373844 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:34.422905 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c82597a369b4035a033cc1372ac51e2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:34.433954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c82597a369b4035a033cc1372ac51e2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:34.434622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c82597a369b4035a033cc1372ac51e2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:34.441260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c82597a369b4035a033cc1372ac51e2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:34.448234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c82597a369b4035a033cc1372ac51e2'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:34.454044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1332/2644] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:35:34 2022] DELETE /identity/v3/users/5c82597a369b4035a033cc1372ac51e2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:34.458864 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36616c51-22c5-4973-a990-f8ce24a40118 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:34.459405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36616c51-22c5-4973-a990-f8ce24a40118 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:34.459499 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36616c51-22c5-4973-a990-f8ce24a40118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:34.478966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-36616c51-22c5-4973-a990-f8ce24a40118 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:34.480316 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-36616c51-22c5-4973-a990-f8ce24a40118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:34.545485 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1313/2645] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:34.555591 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:34.557861 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:34.630464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72e064-8158-45ad-a0c0-6061daf491b1 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:34.634604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7266e8-c769-4321-960e-2f2678bdd041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:34.635257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7266e8-c769-4321-960e-2f2678bdd041 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:34.636626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7266e8-c769-4321-960e-2f2678bdd041 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:34.636626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7266e8-c769-4321-960e-2f2678bdd041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:34.646215 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7266e8-c769-4321-960e-2f2678bdd041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:34.647666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7266e8-c769-4321-960e-2f2678bdd041 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:34.661482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1333/2646] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:34.969015 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36616c51-22c5-4973-a990-f8ce24a40118 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:34.970431 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-36616c51-22c5-4973-a990-f8ce24a40118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:34.984818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36616c51-22c5-4973-a990-f8ce24a40118 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:34.992591 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:34.993934 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:34.994222 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:34.995706 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] PATH_INFO: `/v3/projects/bcfa7e4e93aa4656ba95ce92f336af66` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:34.997998 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcfa7e4e93aa4656ba95ce92f336af66)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:35.000575 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:35.055027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcfa7e4e93aa4656ba95ce92f336af66', 'request_id': 'req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.061920 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcfa7e4e93aa4656ba95ce92f336af66', 'request_id': 'req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.068358 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcfa7e4e93aa4656ba95ce92f336af66', 'request_id': 'req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.081767 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] The token cache is being invalidate because project bcfa7e4e93aa4656ba95ce92f336af66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:35:35.082059 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.082726 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.084399 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1314/2647] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:35:34 2022] DELETE /identity/v3/projects/bcfa7e4e93aa4656ba95ce92f336af66 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:35.089316 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7266e8-c769-4321-960e-2f2678bdd041 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:35.101971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7266e8-c769-4321-960e-2f2678bdd041 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:35.169480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12290a2-5bff-4ec8-8814-28bb43b0ba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:35.170620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12290a2-5bff-4ec8-8814-28bb43b0ba04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:35.170620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12290a2-5bff-4ec8-8814-28bb43b0ba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:35.170909 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12290a2-5bff-4ec8-8814-28bb43b0ba04 admin admin] PATH_INFO: `/v3/users/827872c212f14b169102521f7d2afab5` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:35.172597 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12290a2-5bff-4ec8-8814-28bb43b0ba04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827872c212f14b169102521f7d2afab5)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:35.174546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12290a2-5bff-4ec8-8814-28bb43b0ba04 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:35.226375 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d12290a2-5bff-4ec8-8814-28bb43b0ba04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827872c212f14b169102521f7d2afab5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.238292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d12290a2-5bff-4ec8-8814-28bb43b0ba04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827872c212f14b169102521f7d2afab5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.238982 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d12290a2-5bff-4ec8-8814-28bb43b0ba04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827872c212f14b169102521f7d2afab5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.247404 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d12290a2-5bff-4ec8-8814-28bb43b0ba04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827872c212f14b169102521f7d2afab5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.254417 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d12290a2-5bff-4ec8-8814-28bb43b0ba04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827872c212f14b169102521f7d2afab5'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.260817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1334/2648] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:35:35 2022] DELETE /identity/v3/users/827872c212f14b169102521f7d2afab5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:35.534414 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:35.535998 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:35.550194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3149dee-98b6-4dc8-8d7e-8e4055f9144e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:35.607689 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:35.608602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:35.608879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:35.609156 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5 admin admin] PATH_INFO: `/v3/projects/b8c136a291d44f7583defb3636722d95` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:35.610334 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8c136a291d44f7583defb3636722d95)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:35.612268 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:35.657834 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c136a291d44f7583defb3636722d95', 'request_id': 'req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.663043 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c136a291d44f7583defb3636722d95', 'request_id': 'req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.670028 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c136a291d44f7583defb3636722d95', 'request_id': 'req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.683392 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5 admin admin] The token cache is being invalidate because project b8c136a291d44f7583defb3636722d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:35:35.683679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.684342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-dbed9459-99f7-4dfb-a8d2-3c1ec689abb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:35.685855 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1315/2649] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:35:35 2022] DELETE /identity/v3/projects/b8c136a291d44f7583defb3636722d95 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:35.690667 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e706f-ce1e-4472-9b6c-7ddd438bd7f8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:35.691175 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e706f-ce1e-4472-9b6c-7ddd438bd7f8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:35.691280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e706f-ce1e-4472-9b6c-7ddd438bd7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:35.709549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b02e706f-ce1e-4472-9b6c-7ddd438bd7f8 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:35.710734 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b02e706f-ce1e-4472-9b6c-7ddd438bd7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:35.770636 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1335/2650] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:35.780550 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73e535-3ccd-4e08-a79e-fb2d077ba0a1 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:35.780775 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73e535-3ccd-4e08-a79e-fb2d077ba0a1 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:35.781055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73e535-3ccd-4e08-a79e-fb2d077ba0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:35.800436 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-bd73e535-3ccd-4e08-a79e-fb2d077ba0a1 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:35.801644 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-bd73e535-3ccd-4e08-a79e-fb2d077ba0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:35.810026 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1316/2651] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:35.814297 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e706f-ce1e-4472-9b6c-7ddd438bd7f8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:35.824601 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e706f-ce1e-4472-9b6c-7ddd438bd7f8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:35.829168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967f94e-1a09-4bd9-b47f-f9cb93b3bad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:35.829818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f94e-1a09-4bd9-b47f-f9cb93b3bad3 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:35.830106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f94e-1a09-4bd9-b47f-f9cb93b3bad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:35.830384 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f94e-1a09-4bd9-b47f-f9cb93b3bad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:35.831100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967f94e-1a09-4bd9-b47f-f9cb93b3bad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:35:35.831409 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967f94e-1a09-4bd9-b47f-f9cb93b3bad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:35.833040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967f94e-1a09-4bd9-b47f-f9cb93b3bad3 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:35.844403 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1336/2652] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:35:35.849027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73e535-3ccd-4e08-a79e-fb2d077ba0a1 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:35.859552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73e535-3ccd-4e08-a79e-fb2d077ba0a1 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:35.864552 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2b685-de12-42b0-9787-558c2a8414dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:35.865207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2b685-de12-42b0-9787-558c2a8414dc admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:35.865488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2b685-de12-42b0-9787-558c2a8414dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:35.865768 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2b685-de12-42b0-9787-558c2a8414dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:35.866448 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2b685-de12-42b0-9787-558c2a8414dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:35.869938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2b685-de12-42b0-9787-558c2a8414dc admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:35.896634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1317/2653] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:35:35 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:35.901565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967f94e-1a09-4bd9-b47f-f9cb93b3bad3 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:35.911354 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967f94e-1a09-4bd9-b47f-f9cb93b3bad3 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:35.972295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345cfd7-e10b-4a0d-b1c7-a5fa5e52748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:35.972953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345cfd7-e10b-4a0d-b1c7-a5fa5e52748c admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:35.973231 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345cfd7-e10b-4a0d-b1c7-a5fa5e52748c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:35.973502 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345cfd7-e10b-4a0d-b1c7-a5fa5e52748c admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:35.974182 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345cfd7-e10b-4a0d-b1c7-a5fa5e52748c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:35.976073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345cfd7-e10b-4a0d-b1c7-a5fa5e52748c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:35.995034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1337/2654] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:35:35 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:35.999301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2b685-de12-42b0-9787-558c2a8414dc admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:36.016852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2b685-de12-42b0-9787-558c2a8414dc admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:36.022158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae60051-e62b-401c-b16e-ac4d409bedd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:36.022830 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae60051-e62b-401c-b16e-ac4d409bedd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.023106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae60051-e62b-401c-b16e-ac4d409bedd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.023376 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae60051-e62b-401c-b16e-ac4d409bedd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:36.024186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae60051-e62b-401c-b16e-ac4d409bedd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:36.025869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae60051-e62b-401c-b16e-ac4d409bedd5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:36.036692 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1318/2655] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:36.041468 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345cfd7-e10b-4a0d-b1c7-a5fa5e52748c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:36.051342 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345cfd7-e10b-4a0d-b1c7-a5fa5e52748c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:36.056832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3223d7-fa13-41ce-a5bd-3fdf38f56dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:36.057725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3223d7-fa13-41ce-a5bd-3fdf38f56dce admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.058480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3223d7-fa13-41ce-a5bd-3fdf38f56dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.059055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3223d7-fa13-41ce-a5bd-3fdf38f56dce admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:36.059775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3223d7-fa13-41ce-a5bd-3fdf38f56dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:36.061389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3223d7-fa13-41ce-a5bd-3fdf38f56dce admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:36.071835 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1338/2656] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:36.076009 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae60051-e62b-401c-b16e-ac4d409bedd5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:36.087020 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae60051-e62b-401c-b16e-ac4d409bedd5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:36.092411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c6384-7689-47c3-a8dd-66775b04dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:36.093383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c6384-7689-47c3-a8dd-66775b04dcc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.093717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c6384-7689-47c3-a8dd-66775b04dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.094372 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c6384-7689-47c3-a8dd-66775b04dcc2 admin admin] PATH_INFO: `/v3/projects/43e68c87e6f243abbf2e2a331a1fbf96/users/df6ddce9121f427db22c5c15c4acdf2d/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:36.111294 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c6384-7689-47c3-a8dd-66775b04dcc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e68c87e6f243abbf2e2a331a1fbf96, user_id=df6ddce9121f427db22c5c15c4acdf2d, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:36.114009 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c6384-7689-47c3-a8dd-66775b04dcc2 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:36.127639 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1319/2657] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:36 2022] PUT /identity/v3/projects/43e68c87e6f243abbf2e2a331a1fbf96/users/df6ddce9121f427db22c5c15c4acdf2d/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:36.145096 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b32f5d-1a53-4b89-a5d0-8b91b91c258f None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.145381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b32f5d-1a53-4b89-a5d0-8b91b91c258f None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.145653 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b32f5d-1a53-4b89-a5d0-8b91b91c258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:36.182457 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-02b32f5d-1a53-4b89-a5d0-8b91b91c258f None None] MFA Rules not processed for user `df6ddce9121f427db22c5c15c4acdf2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:36.183666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-02b32f5d-1a53-4b89-a5d0-8b91b91c258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:36.268413 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1339/2658] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:36.272895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c6384-7689-47c3-a8dd-66775b04dcc2 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:36.335937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c6384-7689-47c3-a8dd-66775b04dcc2 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:36.341192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37835c16-d481-4289-9393-ad6c6679e8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:36.341840 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37835c16-d481-4289-9393-ad6c6679e8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.342122 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37835c16-d481-4289-9393-ad6c6679e8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.342396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37835c16-d481-4289-9393-ad6c6679e8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:36.343085 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37835c16-d481-4289-9393-ad6c6679e8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:36.345016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37835c16-d481-4289-9393-ad6c6679e8c4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:36.372932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1320/2659] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:35:36 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:36.376967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b32f5d-1a53-4b89-a5d0-8b91b91c258f None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:36.387507 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b32f5d-1a53-4b89-a5d0-8b91b91c258f None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:36.442775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf1f78-4b2a-4965-b90f-95a9e93532ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:36.443437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf1f78-4b2a-4965-b90f-95a9e93532ac admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.443714 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf1f78-4b2a-4965-b90f-95a9e93532ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.443983 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf1f78-4b2a-4965-b90f-95a9e93532ac admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:36.444699 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf1f78-4b2a-4965-b90f-95a9e93532ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:36.446638 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf1f78-4b2a-4965-b90f-95a9e93532ac admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:36.466537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1340/2660] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:35:36 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:36.470507 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37835c16-d481-4289-9393-ad6c6679e8c4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:36.481356 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37835c16-d481-4289-9393-ad6c6679e8c4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:36.486465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4bc39-3014-4878-baa7-696c801ed602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:36.487116 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4bc39-3014-4878-baa7-696c801ed602 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.487396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4bc39-3014-4878-baa7-696c801ed602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.487829 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4bc39-3014-4878-baa7-696c801ed602 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:36.489922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4bc39-3014-4878-baa7-696c801ed602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:36.491620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4bc39-3014-4878-baa7-696c801ed602 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:36.503888 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1321/2661] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:36.508076 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf1f78-4b2a-4965-b90f-95a9e93532ac admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:36.518082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf1f78-4b2a-4965-b90f-95a9e93532ac admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:36.522684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745238-5335-4920-989a-fb869a9e5ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:36.523547 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745238-5335-4920-989a-fb869a9e5ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.523826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745238-5335-4920-989a-fb869a9e5ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.524190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745238-5335-4920-989a-fb869a9e5ee2 admin admin] PATH_INFO: `/v3/projects/851e6367dae146f1a2ad172a890f6a2d/users/dcb06c4e306b45179c25f8e31fd42ddf/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:36.538548 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59745238-5335-4920-989a-fb869a9e5ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=851e6367dae146f1a2ad172a890f6a2d, user_id=dcb06c4e306b45179c25f8e31fd42ddf, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:36.542053 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59745238-5335-4920-989a-fb869a9e5ee2 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:36.556382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1341/2662] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:36 2022] PUT /identity/v3/projects/851e6367dae146f1a2ad172a890f6a2d/users/dcb06c4e306b45179c25f8e31fd42ddf/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:36.560480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4bc39-3014-4878-baa7-696c801ed602 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:36.570854 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4bc39-3014-4878-baa7-696c801ed602 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:36.627841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b6fab-33ea-4c09-bb2d-06f17231f013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:36.628466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6fab-33ea-4c09-bb2d-06f17231f013 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.628750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6fab-33ea-4c09-bb2d-06f17231f013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.629027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6fab-33ea-4c09-bb2d-06f17231f013 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:36.629770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b6fab-33ea-4c09-bb2d-06f17231f013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:36.631351 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b6fab-33ea-4c09-bb2d-06f17231f013 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:36.641258 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1322/2663] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:36.645629 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745238-5335-4920-989a-fb869a9e5ee2 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:36.656262 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745238-5335-4920-989a-fb869a9e5ee2 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:36.660824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22d288-9107-4fe7-85e3-3f38ad75fc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:36.661681 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22d288-9107-4fe7-85e3-3f38ad75fc4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.661957 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22d288-9107-4fe7-85e3-3f38ad75fc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.662228 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22d288-9107-4fe7-85e3-3f38ad75fc4e admin admin] PATH_INFO: `/v3/projects/851e6367dae146f1a2ad172a890f6a2d/users/dcb06c4e306b45179c25f8e31fd42ddf/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:36.664181 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22d288-9107-4fe7-85e3-3f38ad75fc4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=851e6367dae146f1a2ad172a890f6a2d, user_id=dcb06c4e306b45179c25f8e31fd42ddf, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:36.667663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22d288-9107-4fe7-85e3-3f38ad75fc4e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:36.677898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1342/2664] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:36 2022] PUT /identity/v3/projects/851e6367dae146f1a2ad172a890f6a2d/users/dcb06c4e306b45179c25f8e31fd42ddf/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:36.689583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b730037-fc03-45f3-8f71-c137b2a2c72b None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.689871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b730037-fc03-45f3-8f71-c137b2a2c72b None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.690147 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b730037-fc03-45f3-8f71-c137b2a2c72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:36.716860 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-0b730037-fc03-45f3-8f71-c137b2a2c72b None None] MFA Rules not processed for user `dcb06c4e306b45179c25f8e31fd42ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:36.718377 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0b730037-fc03-45f3-8f71-c137b2a2c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:36.786434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1323/2665] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:36 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:36.798578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22d288-9107-4fe7-85e3-3f38ad75fc4e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:36.800302 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7c22d288-9107-4fe7-85e3-3f38ad75fc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:36.858761 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22d288-9107-4fe7-85e3-3f38ad75fc4e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:36.862347 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9706068-25d0-4760-8c2d-0310330769ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:36.863231 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9706068-25d0-4760-8c2d-0310330769ed service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.863517 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9706068-25d0-4760-8c2d-0310330769ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.863788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9706068-25d0-4760-8c2d-0310330769ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:36.873501 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9706068-25d0-4760-8c2d-0310330769ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:36.875563 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9706068-25d0-4760-8c2d-0310330769ed service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:36.892620 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1343/2666] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:36 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:36.938943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b730037-fc03-45f3-8f71-c137b2a2c72b None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:36.940399 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0b730037-fc03-45f3-8f71-c137b2a2c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:36.953452 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b730037-fc03-45f3-8f71-c137b2a2c72b None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:36.957004 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1b2d4-9c71-4dbb-8071-957427b8e641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:36.957636 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1b2d4-9c71-4dbb-8071-957427b8e641 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:36.957936 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1b2d4-9c71-4dbb-8071-957427b8e641 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:36.958206 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1b2d4-9c71-4dbb-8071-957427b8e641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:37.017703 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1b2d4-9c71-4dbb-8071-957427b8e641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:37.019148 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1b2d4-9c71-4dbb-8071-957427b8e641 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:37.028416 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1324/2667] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:40.209032 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9706068-25d0-4760-8c2d-0310330769ed service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:40.275788 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9706068-25d0-4760-8c2d-0310330769ed service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:40.280174 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:40.281024 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:40.281300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:40.281570 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] PATH_INFO: `/v3/users/df6ddce9121f427db22c5c15c4acdf2d` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:40.282720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6ddce9121f427db22c5c15c4acdf2d)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:40.284649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:40.329473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6ddce9121f427db22c5c15c4acdf2d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:40.341739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6ddce9121f427db22c5c15c4acdf2d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:40.342403 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6ddce9121f427db22c5c15c4acdf2d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:40.349582 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6ddce9121f427db22c5c15c4acdf2d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:40.356909 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6ddce9121f427db22c5c15c4acdf2d'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:40.362720 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1344/2668] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:35:40 2022] DELETE /identity/v3/users/df6ddce9121f427db22c5c15c4acdf2d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:40.367336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc62d7-65a5-49fe-925f-0da7853c48cf None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:40.368005 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc62d7-65a5-49fe-925f-0da7853c48cf None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:40.368207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc62d7-65a5-49fe-925f-0da7853c48cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:40.384994 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-f7dc62d7-65a5-49fe-925f-0da7853c48cf None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:40.386271 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f7dc62d7-65a5-49fe-925f-0da7853c48cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:40.441324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1325/2669] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:40.451158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:40.452553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:40.507724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1a97-cbfb-468b-ba8a-7012abad66ac admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:40.511565 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb539a4-de45-4c32-9265-034639557435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:40.512227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb539a4-de45-4c32-9265-034639557435 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:40.512505 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb539a4-de45-4c32-9265-034639557435 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:40.512778 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb539a4-de45-4c32-9265-034639557435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:40.521493 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb539a4-de45-4c32-9265-034639557435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:40.522906 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb539a4-de45-4c32-9265-034639557435 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:40.532619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1345/2670] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:40.791963 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc62d7-65a5-49fe-925f-0da7853c48cf None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:40.793457 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f7dc62d7-65a5-49fe-925f-0da7853c48cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:40.812135 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc62d7-65a5-49fe-925f-0da7853c48cf None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:40.817577 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:40.818481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:40.818681 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:40.818951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] PATH_INFO: `/v3/projects/43e68c87e6f243abbf2e2a331a1fbf96` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:40.820130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e68c87e6f243abbf2e2a331a1fbf96)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:40.822660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:40.867601 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e68c87e6f243abbf2e2a331a1fbf96', 'request_id': 'req-7864a608-2434-46c8-9a28-0a656a64b506'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:40.872770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e68c87e6f243abbf2e2a331a1fbf96', 'request_id': 'req-7864a608-2434-46c8-9a28-0a656a64b506'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:40.878782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e68c87e6f243abbf2e2a331a1fbf96', 'request_id': 'req-7864a608-2434-46c8-9a28-0a656a64b506'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:40.891441 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] The token cache is being invalidate because project 43e68c87e6f243abbf2e2a331a1fbf96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:35:40.891723 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:40.892363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:40.894116 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1326/2671] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:35:40 2022] DELETE /identity/v3/projects/43e68c87e6f243abbf2e2a331a1fbf96 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:40.897975 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb539a4-de45-4c32-9265-034639557435 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:40.908346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb539a4-de45-4c32-9265-034639557435 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:40.963677 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b51ed-6d72-49a0-9d0d-880c73661cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:40.964576 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b51ed-6d72-49a0-9d0d-880c73661cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:40.964853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b51ed-6d72-49a0-9d0d-880c73661cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:40.965119 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b51ed-6d72-49a0-9d0d-880c73661cfe admin admin] PATH_INFO: `/v3/users/dcb06c4e306b45179c25f8e31fd42ddf` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:40.966310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b51ed-6d72-49a0-9d0d-880c73661cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb06c4e306b45179c25f8e31fd42ddf)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:40.968293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b51ed-6d72-49a0-9d0d-880c73661cfe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:41.016747 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4a2b51ed-6d72-49a0-9d0d-880c73661cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb06c4e306b45179c25f8e31fd42ddf'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:41.029696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4a2b51ed-6d72-49a0-9d0d-880c73661cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb06c4e306b45179c25f8e31fd42ddf'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:41.030470 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4a2b51ed-6d72-49a0-9d0d-880c73661cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb06c4e306b45179c25f8e31fd42ddf'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:41.038111 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4a2b51ed-6d72-49a0-9d0d-880c73661cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb06c4e306b45179c25f8e31fd42ddf'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:41.045770 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4a2b51ed-6d72-49a0-9d0d-880c73661cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb06c4e306b45179c25f8e31fd42ddf'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:41.051561 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1346/2672] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:35:40 2022] DELETE /identity/v3/users/dcb06c4e306b45179c25f8e31fd42ddf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:41.313233 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:41.314879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:41.328399 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864a608-2434-46c8-9a28-0a656a64b506 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:41.385709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f866e1-d13d-4bc5-ba58-e369458859a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:41.386568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f866e1-d13d-4bc5-ba58-e369458859a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:41.386851 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f866e1-d13d-4bc5-ba58-e369458859a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:41.387129 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f866e1-d13d-4bc5-ba58-e369458859a5 admin admin] PATH_INFO: `/v3/projects/851e6367dae146f1a2ad172a890f6a2d` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:41.388328 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f866e1-d13d-4bc5-ba58-e369458859a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=851e6367dae146f1a2ad172a890f6a2d)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:41.390223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f866e1-d13d-4bc5-ba58-e369458859a5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:41.440561 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-01f866e1-d13d-4bc5-ba58-e369458859a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851e6367dae146f1a2ad172a890f6a2d', 'request_id': 'req-01f866e1-d13d-4bc5-ba58-e369458859a5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:41.446727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-01f866e1-d13d-4bc5-ba58-e369458859a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851e6367dae146f1a2ad172a890f6a2d', 'request_id': 'req-01f866e1-d13d-4bc5-ba58-e369458859a5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:41.453274 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-01f866e1-d13d-4bc5-ba58-e369458859a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851e6367dae146f1a2ad172a890f6a2d', 'request_id': 'req-01f866e1-d13d-4bc5-ba58-e369458859a5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:41.469873 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-01f866e1-d13d-4bc5-ba58-e369458859a5 admin admin] The token cache is being invalidate because project 851e6367dae146f1a2ad172a890f6a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:35:41.470169 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-01f866e1-d13d-4bc5-ba58-e369458859a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:41.470842 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-01f866e1-d13d-4bc5-ba58-e369458859a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:41.472583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1327/2673] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:35:41 2022] DELETE /identity/v3/projects/851e6367dae146f1a2ad172a890f6a2d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:35:41.478061 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8de096-bf55-405f-a58e-31204507bb6d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:41.478654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8de096-bf55-405f-a58e-31204507bb6d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:41.478654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8de096-bf55-405f-a58e-31204507bb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:41.497728 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-4e8de096-bf55-405f-a58e-31204507bb6d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:41.498922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4e8de096-bf55-405f-a58e-31204507bb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:41.557016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1347/2674] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:41.564740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d0e3b-16bc-4b5f-a5da-96da6581d28a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:41.565029 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d0e3b-16bc-4b5f-a5da-96da6581d28a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:41.565307 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d0e3b-16bc-4b5f-a5da-96da6581d28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:41.583067 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-b96d0e3b-16bc-4b5f-a5da-96da6581d28a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:41.584280 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-b96d0e3b-16bc-4b5f-a5da-96da6581d28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:41.592769 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1328/2675] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:35:41.596914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8de096-bf55-405f-a58e-31204507bb6d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:41.607162 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8de096-bf55-405f-a58e-31204507bb6d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:41.611679 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c9fd1-d090-4196-8a5b-7a6954e73801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:41.612369 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c9fd1-d090-4196-8a5b-7a6954e73801 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:41.612654 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c9fd1-d090-4196-8a5b-7a6954e73801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:41.612931 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c9fd1-d090-4196-8a5b-7a6954e73801 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:41.613648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c9fd1-d090-4196-8a5b-7a6954e73801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:35:41.613956 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c9fd1-d090-4196-8a5b-7a6954e73801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:41.615546 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c9fd1-d090-4196-8a5b-7a6954e73801 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:41.627857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1348/2676] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:35:41.631947 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d0e3b-16bc-4b5f-a5da-96da6581d28a None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:41.640956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d0e3b-16bc-4b5f-a5da-96da6581d28a None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:41.645870 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4709ad0-0f07-4cc8-970c-f37799d16e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:41.646549 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4709ad0-0f07-4cc8-970c-f37799d16e47 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:41.646835 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4709ad0-0f07-4cc8-970c-f37799d16e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:41.647113 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4709ad0-0f07-4cc8-970c-f37799d16e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:41.647803 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4709ad0-0f07-4cc8-970c-f37799d16e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:41.649747 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4709ad0-0f07-4cc8-970c-f37799d16e47 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:41.675068 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1329/2677] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:35:41 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:35:41.679141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c9fd1-d090-4196-8a5b-7a6954e73801 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:41.689794 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c9fd1-d090-4196-8a5b-7a6954e73801 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:41.753168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e80e4-0625-4bcc-9d8d-0d2d0e38cb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:41.753833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e80e4-0625-4bcc-9d8d-0d2d0e38cb2c admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:41.754115 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e80e4-0625-4bcc-9d8d-0d2d0e38cb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:41.754391 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e80e4-0625-4bcc-9d8d-0d2d0e38cb2c admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:41.755072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e80e4-0625-4bcc-9d8d-0d2d0e38cb2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:41.757044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e80e4-0625-4bcc-9d8d-0d2d0e38cb2c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:41.776916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1349/2678] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:35:41 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:41.781031 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4709ad0-0f07-4cc8-970c-f37799d16e47 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:41.791962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4709ad0-0f07-4cc8-970c-f37799d16e47 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:41.796624 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f067272-cf6a-4eb0-ae28-81c027506476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:41.797272 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f067272-cf6a-4eb0-ae28-81c027506476 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:41.797558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f067272-cf6a-4eb0-ae28-81c027506476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:41.797832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f067272-cf6a-4eb0-ae28-81c027506476 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:41.798542 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f067272-cf6a-4eb0-ae28-81c027506476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:41.800158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f067272-cf6a-4eb0-ae28-81c027506476 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:41.811035 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1330/2679] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:41.815038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e80e4-0625-4bcc-9d8d-0d2d0e38cb2c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:41.825003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e80e4-0625-4bcc-9d8d-0d2d0e38cb2c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:41.829786 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cfbaf-a342-4f46-964c-c5634c832771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:41.830406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cfbaf-a342-4f46-964c-c5634c832771 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:41.830682 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cfbaf-a342-4f46-964c-c5634c832771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:41.830952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cfbaf-a342-4f46-964c-c5634c832771 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:41.831666 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cfbaf-a342-4f46-964c-c5634c832771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:41.833267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cfbaf-a342-4f46-964c-c5634c832771 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:41.843415 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1350/2680] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:41.847595 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f067272-cf6a-4eb0-ae28-81c027506476 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:41.859457 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f067272-cf6a-4eb0-ae28-81c027506476 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:41.864187 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a804c-17d2-4dec-bc94-0c293d80342a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:41.865051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a804c-17d2-4dec-bc94-0c293d80342a admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:41.865332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a804c-17d2-4dec-bc94-0c293d80342a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:41.865606 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a804c-17d2-4dec-bc94-0c293d80342a admin admin] PATH_INFO: `/v3/projects/fcaa0ccd0d154833babaf6c712c98fb3/users/cc831305a7714e6a98a958eb71134ba3/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:41.880292 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a804c-17d2-4dec-bc94-0c293d80342a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcaa0ccd0d154833babaf6c712c98fb3, user_id=cc831305a7714e6a98a958eb71134ba3, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:41.882937 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a804c-17d2-4dec-bc94-0c293d80342a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:41.895986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1331/2681] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:41 2022] PUT /identity/v3/projects/fcaa0ccd0d154833babaf6c712c98fb3/users/cc831305a7714e6a98a958eb71134ba3/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:41.906890 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e75a2f-1db8-4a6b-97ed-e88ccf18d289 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:41.907177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e75a2f-1db8-4a6b-97ed-e88ccf18d289 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:41.907488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e75a2f-1db8-4a6b-97ed-e88ccf18d289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:41.933970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-54e75a2f-1db8-4a6b-97ed-e88ccf18d289 None None] MFA Rules not processed for user `cc831305a7714e6a98a958eb71134ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:41.935163 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-54e75a2f-1db8-4a6b-97ed-e88ccf18d289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:41.995339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1351/2682] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:41.999845 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a804c-17d2-4dec-bc94-0c293d80342a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:42.061956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a804c-17d2-4dec-bc94-0c293d80342a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:42.066554 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28417-5966-4c42-805e-6f349f136f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:42.067198 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28417-5966-4c42-805e-6f349f136f5a admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:42.067483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28417-5966-4c42-805e-6f349f136f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:42.067756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28417-5966-4c42-805e-6f349f136f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:42.068481 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b28417-5966-4c42-805e-6f349f136f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:42.070374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b28417-5966-4c42-805e-6f349f136f5a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:42.095214 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1332/2683] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:35:41 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:42.099204 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e75a2f-1db8-4a6b-97ed-e88ccf18d289 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:42.109897 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e75a2f-1db8-4a6b-97ed-e88ccf18d289 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:42.166441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee8281-f81f-4e55-ae3c-cac9615441f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:42.167100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee8281-f81f-4e55-ae3c-cac9615441f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:42.167378 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee8281-f81f-4e55-ae3c-cac9615441f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:42.167649 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee8281-f81f-4e55-ae3c-cac9615441f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:42.168372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee8281-f81f-4e55-ae3c-cac9615441f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:42.170260 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee8281-f81f-4e55-ae3c-cac9615441f4 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:42.190216 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1352/2684] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:35:42 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:42.194234 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28417-5966-4c42-805e-6f349f136f5a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:42.205028 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28417-5966-4c42-805e-6f349f136f5a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:42.209782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5d447-3062-4d9f-ba44-baa946605cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:42.210509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5d447-3062-4d9f-ba44-baa946605cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:42.210795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5d447-3062-4d9f-ba44-baa946605cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:42.211069 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5d447-3062-4d9f-ba44-baa946605cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:42.212087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5d447-3062-4d9f-ba44-baa946605cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:42.214031 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5d447-3062-4d9f-ba44-baa946605cf9 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:42.224008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1333/2685] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:42.228846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee8281-f81f-4e55-ae3c-cac9615441f4 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:42.238938 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee8281-f81f-4e55-ae3c-cac9615441f4 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:42.244381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb6e17-85b6-425f-ac00-8d1957af7592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:42.245240 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb6e17-85b6-425f-ac00-8d1957af7592 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:42.245544 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb6e17-85b6-425f-ac00-8d1957af7592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:42.245833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb6e17-85b6-425f-ac00-8d1957af7592 admin admin] PATH_INFO: `/v3/projects/1cb9987e07a840bb9675a5bff1c966d2/users/773a95356297466ba5b992aa2ad170be/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:42.260266 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb6e17-85b6-425f-ac00-8d1957af7592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb9987e07a840bb9675a5bff1c966d2, user_id=773a95356297466ba5b992aa2ad170be, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:42.262886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb6e17-85b6-425f-ac00-8d1957af7592 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:42.275040 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1353/2686] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:42 2022] PUT /identity/v3/projects/1cb9987e07a840bb9675a5bff1c966d2/users/773a95356297466ba5b992aa2ad170be/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:35:42.278895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5d447-3062-4d9f-ba44-baa946605cf9 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:42.288958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5d447-3062-4d9f-ba44-baa946605cf9 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:42.343711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538e1f2-0514-4505-a287-48fb11b24a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:42.344394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538e1f2-0514-4505-a287-48fb11b24a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:42.344671 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538e1f2-0514-4505-a287-48fb11b24a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:42.344940 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538e1f2-0514-4505-a287-48fb11b24a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:42.345640 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538e1f2-0514-4505-a287-48fb11b24a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:42.347208 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538e1f2-0514-4505-a287-48fb11b24a21 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:42.357086 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1334/2687] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:42.361320 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb6e17-85b6-425f-ac00-8d1957af7592 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:42.372143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb6e17-85b6-425f-ac00-8d1957af7592 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:42.377004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c1fbe-882e-4e03-bca2-05d6a07af139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:42.377872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c1fbe-882e-4e03-bca2-05d6a07af139 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:42.378150 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c1fbe-882e-4e03-bca2-05d6a07af139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:42.378422 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c1fbe-882e-4e03-bca2-05d6a07af139 admin admin] PATH_INFO: `/v3/projects/1cb9987e07a840bb9675a5bff1c966d2/users/773a95356297466ba5b992aa2ad170be/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:42.380372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c1fbe-882e-4e03-bca2-05d6a07af139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb9987e07a840bb9675a5bff1c966d2, user_id=773a95356297466ba5b992aa2ad170be, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:42.383043 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c1fbe-882e-4e03-bca2-05d6a07af139 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:42.393016 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1354/2688] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:42 2022] PUT /identity/v3/projects/1cb9987e07a840bb9675a5bff1c966d2/users/773a95356297466ba5b992aa2ad170be/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:42.403953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5119b-98a8-4996-957f-644bd224ca20 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:42.404488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5119b-98a8-4996-957f-644bd224ca20 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:42.404600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5119b-98a8-4996-957f-644bd224ca20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:42.431607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-66c5119b-98a8-4996-957f-644bd224ca20 None None] MFA Rules not processed for user `773a95356297466ba5b992aa2ad170be`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:42.432955 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-66c5119b-98a8-4996-957f-644bd224ca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:42.499218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1335/2689] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:42.509385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c1fbe-882e-4e03-bca2-05d6a07af139 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:42.511055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-716c1fbe-882e-4e03-bca2-05d6a07af139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:42.565579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c1fbe-882e-4e03-bca2-05d6a07af139 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:42.569180 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07a534-0277-444f-8a41-94adb1455053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:42.569808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07a534-0277-444f-8a41-94adb1455053 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:42.570088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07a534-0277-444f-8a41-94adb1455053 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:42.570358 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07a534-0277-444f-8a41-94adb1455053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:42.579037 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07a534-0277-444f-8a41-94adb1455053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:42.580485 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07a534-0277-444f-8a41-94adb1455053 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:42.589951 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1355/2690] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:42.668083 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5119b-98a8-4996-957f-644bd224ca20 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:42.677849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5119b-98a8-4996-957f-644bd224ca20 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:42.682511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a47242-bd8c-4a1f-be5a-c66b850d2247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:42.683147 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47242-bd8c-4a1f-be5a-c66b850d2247 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:42.683425 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47242-bd8c-4a1f-be5a-c66b850d2247 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:42.683725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47242-bd8c-4a1f-be5a-c66b850d2247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:42.737910 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a47242-bd8c-4a1f-be5a-c66b850d2247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:42.739340 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a47242-bd8c-4a1f-be5a-c66b850d2247 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:42.747962 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1336/2691] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:47.325361 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07a534-0277-444f-8a41-94adb1455053 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:47.389289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07a534-0277-444f-8a41-94adb1455053 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:47.393773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:47.394644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:47.394923 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:47.395186 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] PATH_INFO: `/v3/users/cc831305a7714e6a98a958eb71134ba3` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:47.396373 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc831305a7714e6a98a958eb71134ba3)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:47.398257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:47.443523 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc831305a7714e6a98a958eb71134ba3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:47.455656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc831305a7714e6a98a958eb71134ba3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:47.456355 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc831305a7714e6a98a958eb71134ba3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:47.463767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc831305a7714e6a98a958eb71134ba3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:47.470206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc831305a7714e6a98a958eb71134ba3'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:47.475912 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1356/2692] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:35:47 2022] DELETE /identity/v3/users/cc831305a7714e6a98a958eb71134ba3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:47.481022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbfc6b-70c4-4a6d-b448-7dbaa3c0f8a9 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:47.481533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbfc6b-70c4-4a6d-b448-7dbaa3c0f8a9 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:47.481636 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbfc6b-70c4-4a6d-b448-7dbaa3c0f8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:47.498986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-54bbfc6b-70c4-4a6d-b448-7dbaa3c0f8a9 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:47.500136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-54bbfc6b-70c4-4a6d-b448-7dbaa3c0f8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:47.557660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1337/2693] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:35:47.567323 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:47.568721 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:47.626161 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fb366-2f6f-4059-aba6-fdc6bf011f4c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:47.629888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20d2b2-9303-4865-89d7-a016063e1c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:47.630528 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20d2b2-9303-4865-89d7-a016063e1c43 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:47.630811 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20d2b2-9303-4865-89d7-a016063e1c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:47.631087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20d2b2-9303-4865-89d7-a016063e1c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:47.640357 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20d2b2-9303-4865-89d7-a016063e1c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:47.641819 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20d2b2-9303-4865-89d7-a016063e1c43 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:47.651216 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1357/2694] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:47.911832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbfc6b-70c4-4a6d-b448-7dbaa3c0f8a9 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:47.913301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-54bbfc6b-70c4-4a6d-b448-7dbaa3c0f8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:47.925771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbfc6b-70c4-4a6d-b448-7dbaa3c0f8a9 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:47.931072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:47.931923 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:47.932213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:47.932479 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] PATH_INFO: `/v3/projects/fcaa0ccd0d154833babaf6c712c98fb3` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:47.933756 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcaa0ccd0d154833babaf6c712c98fb3)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:47.942696 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:47.989629 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcaa0ccd0d154833babaf6c712c98fb3', 'request_id': 'req-046f77ca-9bd1-49e6-9b2b-744799fca722'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:47.995717 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcaa0ccd0d154833babaf6c712c98fb3', 'request_id': 'req-046f77ca-9bd1-49e6-9b2b-744799fca722'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.001724 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcaa0ccd0d154833babaf6c712c98fb3', 'request_id': 'req-046f77ca-9bd1-49e6-9b2b-744799fca722'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.014867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] The token cache is being invalidate because project fcaa0ccd0d154833babaf6c712c98fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:35:48.015080 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.016101 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.017348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1338/2695] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:35:47 2022] DELETE /identity/v3/projects/fcaa0ccd0d154833babaf6c712c98fb3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:35:48.021429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20d2b2-9303-4865-89d7-a016063e1c43 service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:48.030877 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20d2b2-9303-4865-89d7-a016063e1c43 service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:48.084886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab47c1b-70ea-49ee-93ce-e7d52d4270ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:48.085741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab47c1b-70ea-49ee-93ce-e7d52d4270ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:48.086023 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab47c1b-70ea-49ee-93ce-e7d52d4270ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:48.086296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab47c1b-70ea-49ee-93ce-e7d52d4270ad admin admin] PATH_INFO: `/v3/users/773a95356297466ba5b992aa2ad170be` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:48.088130 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab47c1b-70ea-49ee-93ce-e7d52d4270ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=773a95356297466ba5b992aa2ad170be)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:48.090037 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab47c1b-70ea-49ee-93ce-e7d52d4270ad admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:48.134155 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bab47c1b-70ea-49ee-93ce-e7d52d4270ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773a95356297466ba5b992aa2ad170be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.145211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bab47c1b-70ea-49ee-93ce-e7d52d4270ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773a95356297466ba5b992aa2ad170be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.145867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bab47c1b-70ea-49ee-93ce-e7d52d4270ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773a95356297466ba5b992aa2ad170be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.153034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bab47c1b-70ea-49ee-93ce-e7d52d4270ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773a95356297466ba5b992aa2ad170be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.159675 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-bab47c1b-70ea-49ee-93ce-e7d52d4270ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773a95356297466ba5b992aa2ad170be'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.166309 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1358/2696] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:35:48 2022] DELETE /identity/v3/users/773a95356297466ba5b992aa2ad170be => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:48.423838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:48.425342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:48.440850 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f77ca-9bd1-49e6-9b2b-744799fca722 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:48.497300 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c746e-dda1-4d77-ada2-128067048467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:48.498146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c746e-dda1-4d77-ada2-128067048467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:48.498420 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c746e-dda1-4d77-ada2-128067048467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:48.498688 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c746e-dda1-4d77-ada2-128067048467 admin admin] PATH_INFO: `/v3/projects/1cb9987e07a840bb9675a5bff1c966d2` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:48.499838 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c746e-dda1-4d77-ada2-128067048467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb9987e07a840bb9675a5bff1c966d2)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:48.501754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c746e-dda1-4d77-ada2-128067048467 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:48.546663 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7f7c746e-dda1-4d77-ada2-128067048467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb9987e07a840bb9675a5bff1c966d2', 'request_id': 'req-7f7c746e-dda1-4d77-ada2-128067048467'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.551910 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7f7c746e-dda1-4d77-ada2-128067048467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb9987e07a840bb9675a5bff1c966d2', 'request_id': 'req-7f7c746e-dda1-4d77-ada2-128067048467'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.558243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7f7c746e-dda1-4d77-ada2-128067048467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb9987e07a840bb9675a5bff1c966d2', 'request_id': 'req-7f7c746e-dda1-4d77-ada2-128067048467'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.570135 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7f7c746e-dda1-4d77-ada2-128067048467 admin admin] The token cache is being invalidate because project 1cb9987e07a840bb9675a5bff1c966d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:35:48.570417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7f7c746e-dda1-4d77-ada2-128067048467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.571696 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7f7c746e-dda1-4d77-ada2-128067048467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:35:48.573225 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1339/2697] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:35:48 2022] DELETE /identity/v3/projects/1cb9987e07a840bb9675a5bff1c966d2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:48.578230 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833d7c8-2a0b-438f-97c1-9e10de22976d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:48.578711 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833d7c8-2a0b-438f-97c1-9e10de22976d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:48.578817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833d7c8-2a0b-438f-97c1-9e10de22976d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:48.596079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-b833d7c8-2a0b-438f-97c1-9e10de22976d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:48.597273 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-b833d7c8-2a0b-438f-97c1-9e10de22976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:48.654554 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1359/2698] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:48.662501 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c07a7f-5cee-4bb7-b78f-fdd6881c6a6c None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:48.662794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c07a7f-5cee-4bb7-b78f-fdd6881c6a6c None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:48.663106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c07a7f-5cee-4bb7-b78f-fdd6881c6a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:48.682699 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-85c07a7f-5cee-4bb7-b78f-fdd6881c6a6c None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:48.683884 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-85c07a7f-5cee-4bb7-b78f-fdd6881c6a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:48.691644 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1340/2699] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:48.695695 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833d7c8-2a0b-438f-97c1-9e10de22976d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:48.706275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833d7c8-2a0b-438f-97c1-9e10de22976d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:48.710757 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34778ca-43dc-44e5-986c-6984d33957b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:48.711397 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34778ca-43dc-44e5-986c-6984d33957b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:48.711752 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34778ca-43dc-44e5-986c-6984d33957b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:48.712115 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34778ca-43dc-44e5-986c-6984d33957b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:48.712839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34778ca-43dc-44e5-986c-6984d33957b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:35:48.713142 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34778ca-43dc-44e5-986c-6984d33957b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:48.715037 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34778ca-43dc-44e5-986c-6984d33957b9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:48.726167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1360/2700] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:35:48.730669 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c07a7f-5cee-4bb7-b78f-fdd6881c6a6c None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:48.739656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c07a7f-5cee-4bb7-b78f-fdd6881c6a6c None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:48.744939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab61e95-7d4b-4325-bb47-cfb5a2cd2620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:48.745578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab61e95-7d4b-4325-bb47-cfb5a2cd2620 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:48.745853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab61e95-7d4b-4325-bb47-cfb5a2cd2620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:48.746124 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab61e95-7d4b-4325-bb47-cfb5a2cd2620 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:48.746804 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab61e95-7d4b-4325-bb47-cfb5a2cd2620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:48.748720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab61e95-7d4b-4325-bb47-cfb5a2cd2620 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:48.773646 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1341/2701] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:35:48 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:48.777838 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34778ca-43dc-44e5-986c-6984d33957b9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:48.787359 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34778ca-43dc-44e5-986c-6984d33957b9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:48.846389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37b1c5-f48b-4b89-976e-c291e7427527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:48.847053 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37b1c5-f48b-4b89-976e-c291e7427527 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:48.847332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37b1c5-f48b-4b89-976e-c291e7427527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:48.847608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37b1c5-f48b-4b89-976e-c291e7427527 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:48.848530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37b1c5-f48b-4b89-976e-c291e7427527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:48.850408 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37b1c5-f48b-4b89-976e-c291e7427527 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:48.870189 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1361/2702] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:35:48 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:35:48.874219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab61e95-7d4b-4325-bb47-cfb5a2cd2620 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:48.885077 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab61e95-7d4b-4325-bb47-cfb5a2cd2620 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:48.889731 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90413a-bb3e-4075-9921-3cf5ee5d1866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:48.890376 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90413a-bb3e-4075-9921-3cf5ee5d1866 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:48.890660 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90413a-bb3e-4075-9921-3cf5ee5d1866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:48.890939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90413a-bb3e-4075-9921-3cf5ee5d1866 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:48.891651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90413a-bb3e-4075-9921-3cf5ee5d1866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:48.893286 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e90413a-bb3e-4075-9921-3cf5ee5d1866 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:48.903396 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1342/2703] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:35:48.907129 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37b1c5-f48b-4b89-976e-c291e7427527 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:48.917548 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37b1c5-f48b-4b89-976e-c291e7427527 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:48.922093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d741e3f-d70b-4d8d-8727-1f07804791bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:48.922729 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d741e3f-d70b-4d8d-8727-1f07804791bb admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:48.923010 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d741e3f-d70b-4d8d-8727-1f07804791bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:48.923283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d741e3f-d70b-4d8d-8727-1f07804791bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:48.924134 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d741e3f-d70b-4d8d-8727-1f07804791bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:48.925789 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d741e3f-d70b-4d8d-8727-1f07804791bb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:48.936347 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1362/2704] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:48.940332 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90413a-bb3e-4075-9921-3cf5ee5d1866 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:48.951035 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90413a-bb3e-4075-9921-3cf5ee5d1866 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:48.955849 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090c244-e5ef-4381-a677-00cdc1a749f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:48.956751 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090c244-e5ef-4381-a677-00cdc1a749f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:48.957308 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090c244-e5ef-4381-a677-00cdc1a749f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:48.957578 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090c244-e5ef-4381-a677-00cdc1a749f4 admin admin] PATH_INFO: `/v3/projects/facc2e90f7094144b7bce35e32b72941/users/0769c8d8378c4f5dbfb7d1de62e6e5cf/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:48.972535 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090c244-e5ef-4381-a677-00cdc1a749f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=facc2e90f7094144b7bce35e32b72941, user_id=0769c8d8378c4f5dbfb7d1de62e6e5cf, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:48.975186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090c244-e5ef-4381-a677-00cdc1a749f4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:48.988835 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1343/2705] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:48 2022] PUT /identity/v3/projects/facc2e90f7094144b7bce35e32b72941/users/0769c8d8378c4f5dbfb7d1de62e6e5cf/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:35:48.994125 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f1486-5e92-433b-8bfe-187398df1ca5 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:48.994413 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f1486-5e92-433b-8bfe-187398df1ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:48.994700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f1486-5e92-433b-8bfe-187398df1ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:49.012888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-343f1486-5e92-433b-8bfe-187398df1ca5 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:49.014126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-343f1486-5e92-433b-8bfe-187398df1ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:49.073355 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1363/2706] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:49.082967 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090c244-e5ef-4381-a677-00cdc1a749f4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:49.084719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f090c244-e5ef-4381-a677-00cdc1a749f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:49.139732 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090c244-e5ef-4381-a677-00cdc1a749f4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:49.143368 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824bab-0d76-4699-9d24-b78d67a23ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:49.143996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824bab-0d76-4699-9d24-b78d67a23ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:49.144316 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824bab-0d76-4699-9d24-b78d67a23ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:49.144592 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62824bab-0d76-4699-9d24-b78d67a23ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:49.154141 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62824bab-0d76-4699-9d24-b78d67a23ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:49.155563 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62824bab-0d76-4699-9d24-b78d67a23ea1 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:49.165816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1344/2707] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:35:53.493671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d694f6-9cad-4c49-af07-97a0505af126 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:53.494144 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d694f6-9cad-4c49-af07-97a0505af126 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:53.494228 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d694f6-9cad-4c49-af07-97a0505af126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:53.529608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-15d694f6-9cad-4c49-af07-97a0505af126 None None] MFA Rules not processed for user `0769c8d8378c4f5dbfb7d1de62e6e5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:35:53.530817 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-15d694f6-9cad-4c49-af07-97a0505af126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:35:53.603898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1364/2708] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:35:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:35:53.608349 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824bab-0d76-4699-9d24-b78d67a23ea1 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:53.618836 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62824bab-0d76-4699-9d24-b78d67a23ea1 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:53.623796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d6116-fe60-417d-a7bf-83a9ed953a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:53.624598 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d6116-fe60-417d-a7bf-83a9ed953a57 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:53.624857 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d6116-fe60-417d-a7bf-83a9ed953a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:53.625311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d6116-fe60-417d-a7bf-83a9ed953a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:53.626006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d6116-fe60-417d-a7bf-83a9ed953a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:53.627922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d6116-fe60-417d-a7bf-83a9ed953a57 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:53.658605 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1345/2709] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:35:53 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:53.662609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d694f6-9cad-4c49-af07-97a0505af126 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:53.678137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d694f6-9cad-4c49-af07-97a0505af126 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:53.747322 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b46b07-01bb-4c9f-86e1-d76bf4a56399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:53.748013 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b46b07-01bb-4c9f-86e1-d76bf4a56399 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:53.748491 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b46b07-01bb-4c9f-86e1-d76bf4a56399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:53.748777 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b46b07-01bb-4c9f-86e1-d76bf4a56399 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:53.749534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b46b07-01bb-4c9f-86e1-d76bf4a56399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:53.751550 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b46b07-01bb-4c9f-86e1-d76bf4a56399 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:53.782574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1365/2710] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:35:53 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:35:53.783603 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d6116-fe60-417d-a7bf-83a9ed953a57 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:53.796360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d6116-fe60-417d-a7bf-83a9ed953a57 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:53.801648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c8508-84a6-4f68-abc4-4ceacb0cff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:53.802314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c8508-84a6-4f68-abc4-4ceacb0cff30 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:53.802821 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c8508-84a6-4f68-abc4-4ceacb0cff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:53.803101 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c8508-84a6-4f68-abc4-4ceacb0cff30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:53.803831 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c8508-84a6-4f68-abc4-4ceacb0cff30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:53.806229 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c8508-84a6-4f68-abc4-4ceacb0cff30 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:53.820207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1346/2711] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:35:53.825052 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b46b07-01bb-4c9f-86e1-d76bf4a56399 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:53.835846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b46b07-01bb-4c9f-86e1-d76bf4a56399 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:53.841334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcbac3-4029-4715-b2d3-71bad0e6cad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:53.842395 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcbac3-4029-4715-b2d3-71bad0e6cad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:53.842735 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcbac3-4029-4715-b2d3-71bad0e6cad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:53.843024 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcbac3-4029-4715-b2d3-71bad0e6cad0 admin admin] PATH_INFO: `/v3/projects/71a053c2fc2f46998bf82a62c1f9178e/users/f7853b3d20144602a1e6d9741b81b3c4/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:53.860343 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcbac3-4029-4715-b2d3-71bad0e6cad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a053c2fc2f46998bf82a62c1f9178e, user_id=f7853b3d20144602a1e6d9741b81b3c4, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:53.867137 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcbac3-4029-4715-b2d3-71bad0e6cad0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:53.888521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1366/2712] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:53 2022] PUT /identity/v3/projects/71a053c2fc2f46998bf82a62c1f9178e/users/f7853b3d20144602a1e6d9741b81b3c4/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:35:53.892757 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c8508-84a6-4f68-abc4-4ceacb0cff30 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:53.903816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c8508-84a6-4f68-abc4-4ceacb0cff30 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:53.973551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7a0aa-d801-43cd-8d33-66a7ee217aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:53.974164 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7a0aa-d801-43cd-8d33-66a7ee217aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:53.974469 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7a0aa-d801-43cd-8d33-66a7ee217aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:53.975538 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7a0aa-d801-43cd-8d33-66a7ee217aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:53.976704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7a0aa-d801-43cd-8d33-66a7ee217aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:53.979226 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7a0aa-d801-43cd-8d33-66a7ee217aa8 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:53.989310 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1347/2713] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:35:53.994421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcbac3-4029-4715-b2d3-71bad0e6cad0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:35:54.005898 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcbac3-4029-4715-b2d3-71bad0e6cad0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:35:54.016421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff456d-c2cc-4799-bfeb-08041af67414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:35:54.017334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff456d-c2cc-4799-bfeb-08041af67414 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:35:54.017616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff456d-c2cc-4799-bfeb-08041af67414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:35:54.017891 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff456d-c2cc-4799-bfeb-08041af67414 admin admin] PATH_INFO: `/v3/projects/71a053c2fc2f46998bf82a62c1f9178e/users/f7853b3d20144602a1e6d9741b81b3c4/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:35:54.020143 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff456d-c2cc-4799-bfeb-08041af67414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a053c2fc2f46998bf82a62c1f9178e, user_id=f7853b3d20144602a1e6d9741b81b3c4, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:35:54.022879 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff456d-c2cc-4799-bfeb-08041af67414 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:35:54.037300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1367/2714] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:35:53 2022] PUT /identity/v3/projects/71a053c2fc2f46998bf82a62c1f9178e/users/f7853b3d20144602a1e6d9741b81b3c4/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:00.099186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab699-4a66-4520-9f7b-055aeb97381d None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:00.099680 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab699-4a66-4520-9f7b-055aeb97381d None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:00.099680 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab699-4a66-4520-9f7b-055aeb97381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:00.153772 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-dfaab699-4a66-4520-9f7b-055aeb97381d None None] MFA Rules not processed for user `f7853b3d20144602a1e6d9741b81b3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:00.155380 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-dfaab699-4a66-4520-9f7b-055aeb97381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:00.262753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1348/2715] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:36:00.273355 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff456d-c2cc-4799-bfeb-08041af67414 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:00.275280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-2dff456d-c2cc-4799-bfeb-08041af67414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:00.356776 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff456d-c2cc-4799-bfeb-08041af67414 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:00.362221 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1568e-a644-4f3f-94e4-3c08d7f9f480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:00.362862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1568e-a644-4f3f-94e4-3c08d7f9f480 service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:00.363158 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1568e-a644-4f3f-94e4-3c08d7f9f480 service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:00.363410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1568e-a644-4f3f-94e4-3c08d7f9f480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:00.421004 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1568e-a644-4f3f-94e4-3c08d7f9f480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:00.422609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1568e-a644-4f3f-94e4-3c08d7f9f480 service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:00.432668 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1368/2716] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:02.131755 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354dff6-a497-4944-8dbb-bfbbf0162df0 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:02.132335 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354dff6-a497-4944-8dbb-bfbbf0162df0 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:02.132432 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354dff6-a497-4944-8dbb-bfbbf0162df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:02.154207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-e354dff6-a497-4944-8dbb-bfbbf0162df0 None None] MFA Rules not processed for user `0769c8d8378c4f5dbfb7d1de62e6e5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:02.155467 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e354dff6-a497-4944-8dbb-bfbbf0162df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:02.162993 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1349/2717] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:36:06.610283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dd8fc-78ab-41f9-9a62-c95031943265 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:06.610851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dd8fc-78ab-41f9-9a62-c95031943265 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:06.610851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dd8fc-78ab-41f9-9a62-c95031943265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:06.628419 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0f8dd8fc-78ab-41f9-9a62-c95031943265 None None] MFA Rules not processed for user `e277c102c82b412481a8a9f888f4a7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:06.629592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0f8dd8fc-78ab-41f9-9a62-c95031943265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:06.684969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1369/2718] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:08.473816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354dff6-a497-4944-8dbb-bfbbf0162df0 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:08.552417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354dff6-a497-4944-8dbb-bfbbf0162df0 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:08.557093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db925d8b-ec20-4a0b-96f2-a8bb10ace685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:08.558049 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db925d8b-ec20-4a0b-96f2-a8bb10ace685 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:08.558338 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db925d8b-ec20-4a0b-96f2-a8bb10ace685 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:08.558619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db925d8b-ec20-4a0b-96f2-a8bb10ace685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:08.560523 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-db925d8b-ec20-4a0b-96f2-a8bb10ace685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:08.639143 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db925d8b-ec20-4a0b-96f2-a8bb10ace685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:08.640930 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db925d8b-ec20-4a0b-96f2-a8bb10ace685 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:08.654022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1350/2719] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:13.064637 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dd8fc-78ab-41f9-9a62-c95031943265 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:13.067710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0f8dd8fc-78ab-41f9-9a62-c95031943265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:13.085556 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dd8fc-78ab-41f9-9a62-c95031943265 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:13.092063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466c6d0-75c8-41c3-8fc2-9c4836302777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:13.093404 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c6d0-75c8-41c3-8fc2-9c4836302777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:13.093690 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c6d0-75c8-41c3-8fc2-9c4836302777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:13.093967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c6d0-75c8-41c3-8fc2-9c4836302777 admin admin] PATH_INFO: `/v3/users/2968933854654df18956bb48d4810159` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:13.095189 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466c6d0-75c8-41c3-8fc2-9c4836302777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2968933854654df18956bb48d4810159)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:13.097464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1466c6d0-75c8-41c3-8fc2-9c4836302777 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:13.181538 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1466c6d0-75c8-41c3-8fc2-9c4836302777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2968933854654df18956bb48d4810159'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:13.194025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1466c6d0-75c8-41c3-8fc2-9c4836302777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2968933854654df18956bb48d4810159'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:13.194998 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1466c6d0-75c8-41c3-8fc2-9c4836302777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2968933854654df18956bb48d4810159'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:13.203792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1466c6d0-75c8-41c3-8fc2-9c4836302777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2968933854654df18956bb48d4810159'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:13.210593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-1466c6d0-75c8-41c3-8fc2-9c4836302777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2968933854654df18956bb48d4810159'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:13.217168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1370/2720] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:36:13 2022] DELETE /identity/v3/users/2968933854654df18956bb48d4810159 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:13.396493 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db925d8b-ec20-4a0b-96f2-a8bb10ace685 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:13.407250 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db925d8b-ec20-4a0b-96f2-a8bb10ace685 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:13.478455 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:13.479568 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:13.479886 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:13.480257 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4 admin admin] PATH_INFO: `/v3/projects/fd441a80d29f4b5db8245c523e2ee25a` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:13.482251 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd441a80d29f4b5db8245c523e2ee25a)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:13.484446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:13.546110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd441a80d29f4b5db8245c523e2ee25a', 'request_id': 'req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:13.552121 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd441a80d29f4b5db8245c523e2ee25a', 'request_id': 'req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:13.559157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd441a80d29f4b5db8245c523e2ee25a', 'request_id': 'req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:13.578590 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4 admin admin] The token cache is being invalidate because project fd441a80d29f4b5db8245c523e2ee25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:36:13.579593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:13.580329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a935ee86-4c9f-44f0-8bb8-336d1a4777a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:13.582192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1351/2721] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:36:13 2022] DELETE /identity/v3/projects/fd441a80d29f4b5db8245c523e2ee25a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:13.586973 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83edd95-0bcf-4334-be60-87f771048b9d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:13.588070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83edd95-0bcf-4334-be60-87f771048b9d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:13.588421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83edd95-0bcf-4334-be60-87f771048b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:13.607356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-f83edd95-0bcf-4334-be60-87f771048b9d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:13.608682 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f83edd95-0bcf-4334-be60-87f771048b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:13.669795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1371/2722] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:13.677631 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ab737-ecdd-4922-b472-5f4c07cd3cfb None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:13.677932 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ab737-ecdd-4922-b472-5f4c07cd3cfb None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:13.678220 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ab737-ecdd-4922-b472-5f4c07cd3cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:13.697850 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-d82ab737-ecdd-4922-b472-5f4c07cd3cfb None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:13.699273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-d82ab737-ecdd-4922-b472-5f4c07cd3cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:13.708741 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1352/2723] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:13.713719 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83edd95-0bcf-4334-be60-87f771048b9d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:13.723294 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83edd95-0bcf-4334-be60-87f771048b9d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:13.728247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c2a6e-e4d8-4305-8f45-b4dfaaf36cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:13.728914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c2a6e-e4d8-4305-8f45-b4dfaaf36cca admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:13.729195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c2a6e-e4d8-4305-8f45-b4dfaaf36cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:13.729630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c2a6e-e4d8-4305-8f45-b4dfaaf36cca admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:13.731945 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c2a6e-e4d8-4305-8f45-b4dfaaf36cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:36:13.732284 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c2a6e-e4d8-4305-8f45-b4dfaaf36cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:13.733903 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c2a6e-e4d8-4305-8f45-b4dfaaf36cca admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:13.745895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1372/2724] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:36:13.750444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ab737-ecdd-4922-b472-5f4c07cd3cfb None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:13.761758 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ab737-ecdd-4922-b472-5f4c07cd3cfb None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:13.766904 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156efd42-02c9-4d13-81bd-da0fd2a7f310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:13.767571 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156efd42-02c9-4d13-81bd-da0fd2a7f310 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:13.767857 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156efd42-02c9-4d13-81bd-da0fd2a7f310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:13.768172 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156efd42-02c9-4d13-81bd-da0fd2a7f310 admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:13.768877 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156efd42-02c9-4d13-81bd-da0fd2a7f310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:13.770780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156efd42-02c9-4d13-81bd-da0fd2a7f310 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:13.800272 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1353/2725] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:36:13 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:13.804440 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c2a6e-e4d8-4305-8f45-b4dfaaf36cca admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:13.816614 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c2a6e-e4d8-4305-8f45-b4dfaaf36cca admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:13.885528 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ad16-8eba-4a9e-ba6b-1a28579c5922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:13.886452 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ad16-8eba-4a9e-ba6b-1a28579c5922 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:13.886767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ad16-8eba-4a9e-ba6b-1a28579c5922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:13.886990 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949ad16-8eba-4a9e-ba6b-1a28579c5922 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:13.887663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ad16-8eba-4a9e-ba6b-1a28579c5922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:13.889579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949ad16-8eba-4a9e-ba6b-1a28579c5922 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:13.918164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1373/2726] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:36:13 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:13.919810 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156efd42-02c9-4d13-81bd-da0fd2a7f310 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:13.935081 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156efd42-02c9-4d13-81bd-da0fd2a7f310 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:13.939990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac138d-da9c-47f2-ba80-e21d172fac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:13.940689 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac138d-da9c-47f2-ba80-e21d172fac4f admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:13.941046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac138d-da9c-47f2-ba80-e21d172fac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:13.941322 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac138d-da9c-47f2-ba80-e21d172fac4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:13.942046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac138d-da9c-47f2-ba80-e21d172fac4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:13.943677 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac138d-da9c-47f2-ba80-e21d172fac4f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:13.957529 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1354/2727] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:36:13.965310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ad16-8eba-4a9e-ba6b-1a28579c5922 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:13.979430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949ad16-8eba-4a9e-ba6b-1a28579c5922 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:13.987710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760db418-6723-4fb2-999c-379ed8994e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:13.988420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760db418-6723-4fb2-999c-379ed8994e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:13.988703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760db418-6723-4fb2-999c-379ed8994e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:13.988978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760db418-6723-4fb2-999c-379ed8994e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:13.989708 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760db418-6723-4fb2-999c-379ed8994e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:13.991311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760db418-6723-4fb2-999c-379ed8994e54 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:14.003922 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1374/2728] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:36:14.008541 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac138d-da9c-47f2-ba80-e21d172fac4f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:14.019099 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac138d-da9c-47f2-ba80-e21d172fac4f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:14.023916 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c3c21-ade7-4018-bd2e-d9ba6478380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:14.024885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c3c21-ade7-4018-bd2e-d9ba6478380e admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:14.025522 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c3c21-ade7-4018-bd2e-d9ba6478380e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:14.025823 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c3c21-ade7-4018-bd2e-d9ba6478380e admin admin] PATH_INFO: `/v3/projects/1828a8ad894a4c29a415c5e1ce3b5db4/users/3a75a9271beb4bdd85d3d37d6b2b752a/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:14.044124 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c3c21-ade7-4018-bd2e-d9ba6478380e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1828a8ad894a4c29a415c5e1ce3b5db4, user_id=3a75a9271beb4bdd85d3d37d6b2b752a, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:14.046827 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c3c21-ade7-4018-bd2e-d9ba6478380e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:14.059906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1355/2729] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:14 2022] PUT /identity/v3/projects/1828a8ad894a4c29a415c5e1ce3b5db4/users/3a75a9271beb4bdd85d3d37d6b2b752a/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:14.071787 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7804d4-ebed-4525-b32f-2174a2f641bf None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:14.072634 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7804d4-ebed-4525-b32f-2174a2f641bf None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:14.072634 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7804d4-ebed-4525-b32f-2174a2f641bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:14.098894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-fd7804d4-ebed-4525-b32f-2174a2f641bf None None] MFA Rules not processed for user `3a75a9271beb4bdd85d3d37d6b2b752a`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:14.100447 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-fd7804d4-ebed-4525-b32f-2174a2f641bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:14.167245 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1375/2730] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:14.178795 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c3c21-ade7-4018-bd2e-d9ba6478380e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:14.180723 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-e47c3c21-ade7-4018-bd2e-d9ba6478380e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:14.272977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c3c21-ade7-4018-bd2e-d9ba6478380e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:14.279626 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4ddf2-a29a-407f-a800-af76710063f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:14.280766 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4ddf2-a29a-407f-a800-af76710063f9 service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:14.281175 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4ddf2-a29a-407f-a800-af76710063f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:14.281456 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4ddf2-a29a-407f-a800-af76710063f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:14.290759 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4ddf2-a29a-407f-a800-af76710063f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:14.292964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4ddf2-a29a-407f-a800-af76710063f9 service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:14.303751 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1356/2731] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:28.930627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7804d4-ebed-4525-b32f-2174a2f641bf None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:28.990738 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7804d4-ebed-4525-b32f-2174a2f641bf None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:28.995455 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:28.996334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:28.996616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:28.996894 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] PATH_INFO: `/v3/users/3a75a9271beb4bdd85d3d37d6b2b752a` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:28.998048 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a75a9271beb4bdd85d3d37d6b2b752a)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:28.999988 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:29.045047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a75a9271beb4bdd85d3d37d6b2b752a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:29.056722 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a75a9271beb4bdd85d3d37d6b2b752a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:29.057382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a75a9271beb4bdd85d3d37d6b2b752a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:29.064443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a75a9271beb4bdd85d3d37d6b2b752a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:29.071154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a75a9271beb4bdd85d3d37d6b2b752a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:29.077823 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1376/2732] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:36:28 2022] DELETE /identity/v3/users/3a75a9271beb4bdd85d3d37d6b2b752a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:29.082624 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eddd94-174e-4602-9d0e-7623e0b8f77a None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:29.083146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eddd94-174e-4602-9d0e-7623e0b8f77a None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:29.083267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eddd94-174e-4602-9d0e-7623e0b8f77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:29.100417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-84eddd94-174e-4602-9d0e-7623e0b8f77a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:29.101605 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-84eddd94-174e-4602-9d0e-7623e0b8f77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:29.158730 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1357/2733] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:29.168808 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:29.170337 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:29.171336 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9bbe9-5d58-439a-8f3a-efa111d71f65 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:29.171634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9bbe9-5d58-439a-8f3a-efa111d71f65 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:29.171940 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a9bbe9-5d58-439a-8f3a-efa111d71f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:29.189695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-18a9bbe9-5d58-439a-8f3a-efa111d71f65 None None] MFA Rules not processed for user `52506eb32d2f49e7aa4d6585b77c1917`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:29.190880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-18a9bbe9-5d58-439a-8f3a-efa111d71f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:29.228033 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bc7bf-876a-41c9-8cdf-940a1f7cf4db admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:29.233991 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166aeb92-5069-490a-ba9f-deab0975b2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:29.234656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aeb92-5069-490a-ba9f-deab0975b2db service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:29.234924 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aeb92-5069-490a-ba9f-deab0975b2db service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:29.235201 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aeb92-5069-490a-ba9f-deab0975b2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:29.245896 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166aeb92-5069-490a-ba9f-deab0975b2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:29.246560 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1358/2734] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:36:29.247450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166aeb92-5069-490a-ba9f-deab0975b2db service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:29.258465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1377/2735] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:29.761583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9bbe9-5d58-439a-8f3a-efa111d71f65 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:29.763071 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-18a9bbe9-5d58-439a-8f3a-efa111d71f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:29.776651 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a9bbe9-5d58-439a-8f3a-efa111d71f65 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:29.781653 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71069c-2396-448a-91c6-e0e4618f5f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:29.782524 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71069c-2396-448a-91c6-e0e4618f5f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:29.784344 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71069c-2396-448a-91c6-e0e4618f5f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:29.784697 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71069c-2396-448a-91c6-e0e4618f5f06 admin admin] PATH_INFO: `/v3/projects/1828a8ad894a4c29a415c5e1ce3b5db4` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:29.786745 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71069c-2396-448a-91c6-e0e4618f5f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1828a8ad894a4c29a415c5e1ce3b5db4)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:29.788121 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71069c-2396-448a-91c6-e0e4618f5f06 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:29.843461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1d71069c-2396-448a-91c6-e0e4618f5f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1828a8ad894a4c29a415c5e1ce3b5db4', 'request_id': 'req-1d71069c-2396-448a-91c6-e0e4618f5f06'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:29.849275 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1d71069c-2396-448a-91c6-e0e4618f5f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1828a8ad894a4c29a415c5e1ce3b5db4', 'request_id': 'req-1d71069c-2396-448a-91c6-e0e4618f5f06'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:29.855583 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1d71069c-2396-448a-91c6-e0e4618f5f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1828a8ad894a4c29a415c5e1ce3b5db4', 'request_id': 'req-1d71069c-2396-448a-91c6-e0e4618f5f06'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:29.868988 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1d71069c-2396-448a-91c6-e0e4618f5f06 admin admin] The token cache is being invalidate because project 1828a8ad894a4c29a415c5e1ce3b5db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:36:29.869276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1d71069c-2396-448a-91c6-e0e4618f5f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:29.869915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-1d71069c-2396-448a-91c6-e0e4618f5f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:29.871487 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1359/2736] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:36:29 2022] DELETE /identity/v3/projects/1828a8ad894a4c29a415c5e1ce3b5db4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:29.877741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480bd67-2770-455a-9b69-cc479771634a None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:29.877741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480bd67-2770-455a-9b69-cc479771634a None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:29.877741 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480bd67-2770-455a-9b69-cc479771634a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:29.913416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7480bd67-2770-455a-9b69-cc479771634a None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:29.914792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7480bd67-2770-455a-9b69-cc479771634a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:29.987610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1378/2737] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:29.996100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f2574-ddc7-4594-9a6c-3ccfe1a2c7a8 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:29.996397 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f2574-ddc7-4594-9a6c-3ccfe1a2c7a8 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:29.996673 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f2574-ddc7-4594-9a6c-3ccfe1a2c7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.021488 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-ed6f2574-ddc7-4594-9a6c-3ccfe1a2c7a8 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:30.022696 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-ed6f2574-ddc7-4594-9a6c-3ccfe1a2c7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:30.034607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1360/2738] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:30.036550 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480bd67-2770-455a-9b69-cc479771634a None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:30.047453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480bd67-2770-455a-9b69-cc479771634a None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:30.052407 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ebcf1-69cc-4aee-b463-44b5a6dbe047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:30.053056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ebcf1-69cc-4aee-b463-44b5a6dbe047 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.053334 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ebcf1-69cc-4aee-b463-44b5a6dbe047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.053606 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ebcf1-69cc-4aee-b463-44b5a6dbe047 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.054317 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ebcf1-69cc-4aee-b463-44b5a6dbe047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:36:30.054618 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ebcf1-69cc-4aee-b463-44b5a6dbe047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:30.057106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ebcf1-69cc-4aee-b463-44b5a6dbe047 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:30.068859 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1379/2739] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 09:36:30.073826 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f2574-ddc7-4594-9a6c-3ccfe1a2c7a8 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:30.083417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f2574-ddc7-4594-9a6c-3ccfe1a2c7a8 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:30.088996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca21e15-0511-43d4-be9e-3c48404ff16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:30.089669 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca21e15-0511-43d4-be9e-3c48404ff16e admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.089951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca21e15-0511-43d4-be9e-3c48404ff16e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.090223 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca21e15-0511-43d4-be9e-3c48404ff16e admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.090935 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca21e15-0511-43d4-be9e-3c48404ff16e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:30.093142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca21e15-0511-43d4-be9e-3c48404ff16e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:30.133077 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1361/2740] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:36:30 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:36:30.134372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ebcf1-69cc-4aee-b463-44b5a6dbe047 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:30.145045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ebcf1-69cc-4aee-b463-44b5a6dbe047 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:30.247199 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021b147-ef2e-4a11-b039-d6ef6207f0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:30.248079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021b147-ef2e-4a11-b039-d6ef6207f0cf admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.248431 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021b147-ef2e-4a11-b039-d6ef6207f0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.248792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021b147-ef2e-4a11-b039-d6ef6207f0cf admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.249771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021b147-ef2e-4a11-b039-d6ef6207f0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:30.251837 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021b147-ef2e-4a11-b039-d6ef6207f0cf admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:30.272280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1380/2741] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:36:30 2022] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:36:30.277943 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca21e15-0511-43d4-be9e-3c48404ff16e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:30.288846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca21e15-0511-43d4-be9e-3c48404ff16e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:30.305444 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b167b-36c1-4ad7-b09c-b50b9cd627d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:30.306164 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b167b-36c1-4ad7-b09c-b50b9cd627d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.306445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b167b-36c1-4ad7-b09c-b50b9cd627d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.307061 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b167b-36c1-4ad7-b09c-b50b9cd627d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.307972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b167b-36c1-4ad7-b09c-b50b9cd627d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:30.309919 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b167b-36c1-4ad7-b09c-b50b9cd627d7 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:30.322887 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1362/2742] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:36:30.327739 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021b147-ef2e-4a11-b039-d6ef6207f0cf admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:30.338895 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021b147-ef2e-4a11-b039-d6ef6207f0cf admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:30.344168 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddaa3a2-7753-4ec4-94cf-ee8091a16408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:30.344981 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddaa3a2-7753-4ec4-94cf-ee8091a16408 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.345270 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddaa3a2-7753-4ec4-94cf-ee8091a16408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.345581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddaa3a2-7753-4ec4-94cf-ee8091a16408 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.346523 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddaa3a2-7753-4ec4-94cf-ee8091a16408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:30.348072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddaa3a2-7753-4ec4-94cf-ee8091a16408 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:30.359433 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1381/2743] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:36:30.363881 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b167b-36c1-4ad7-b09c-b50b9cd627d7 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:30.374440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b167b-36c1-4ad7-b09c-b50b9cd627d7 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:30.379618 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd878e-54ed-472d-b26c-62fa5e541b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:30.380540 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd878e-54ed-472d-b26c-62fa5e541b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.380893 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd878e-54ed-472d-b26c-62fa5e541b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.381240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd878e-54ed-472d-b26c-62fa5e541b6a admin admin] PATH_INFO: `/v3/projects/4e1710ee3c584ca4894e23f9c0c8a88f/users/b0cc09321ed440c1b5d62340feb7d64c/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.397361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd878e-54ed-472d-b26c-62fa5e541b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1710ee3c584ca4894e23f9c0c8a88f, user_id=b0cc09321ed440c1b5d62340feb7d64c, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:30.400798 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd878e-54ed-472d-b26c-62fa5e541b6a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:30.414533 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1363/2744] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:30 2022] PUT /identity/v3/projects/4e1710ee3c584ca4894e23f9c0c8a88f/users/b0cc09321ed440c1b5d62340feb7d64c/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:30.425559 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122f7b-464c-4870-8247-c5e2f6946128 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.425853 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122f7b-464c-4870-8247-c5e2f6946128 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.426138 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba122f7b-464c-4870-8247-c5e2f6946128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.454086 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-ba122f7b-464c-4870-8247-c5e2f6946128 None None] MFA Rules not processed for user `b0cc09321ed440c1b5d62340feb7d64c`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:30.455381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-ba122f7b-464c-4870-8247-c5e2f6946128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:30.544730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1382/2745] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:30.545989 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd878e-54ed-472d-b26c-62fa5e541b6a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:30.613210 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd878e-54ed-472d-b26c-62fa5e541b6a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:30.619173 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf172b-8ca4-4262-8f60-91cc2972420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:30.619878 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf172b-8ca4-4262-8f60-91cc2972420d admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.620204 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf172b-8ca4-4262-8f60-91cc2972420d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.620483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf172b-8ca4-4262-8f60-91cc2972420d admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.621175 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf172b-8ca4-4262-8f60-91cc2972420d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:30.623143 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf172b-8ca4-4262-8f60-91cc2972420d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:30.652610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1364/2746] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:36:30 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:30.653805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba122f7b-464c-4870-8247-c5e2f6946128 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:30.664856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba122f7b-464c-4870-8247-c5e2f6946128 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:30.727206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257955b-4f5e-494c-9b1a-15e1ca2cf908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:30.727879 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257955b-4f5e-494c-9b1a-15e1ca2cf908 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.728183 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257955b-4f5e-494c-9b1a-15e1ca2cf908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.728529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257955b-4f5e-494c-9b1a-15e1ca2cf908 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.729138 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257955b-4f5e-494c-9b1a-15e1ca2cf908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:30.731036 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257955b-4f5e-494c-9b1a-15e1ca2cf908 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:30.756074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1383/2747] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:36:30 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:30.757704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf172b-8ca4-4262-8f60-91cc2972420d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:30.767720 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf172b-8ca4-4262-8f60-91cc2972420d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:30.772474 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7be1c-cd08-4ace-929d-db92e7f897c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:30.773126 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7be1c-cd08-4ace-929d-db92e7f897c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.773410 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7be1c-cd08-4ace-929d-db92e7f897c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.776185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7be1c-cd08-4ace-929d-db92e7f897c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.777053 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7be1c-cd08-4ace-929d-db92e7f897c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:30.778830 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7be1c-cd08-4ace-929d-db92e7f897c4 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:30.791771 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1365/2748] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:36:30.796190 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257955b-4f5e-494c-9b1a-15e1ca2cf908 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:30.806731 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257955b-4f5e-494c-9b1a-15e1ca2cf908 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:30.811994 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c39b2-1855-4e74-9160-6a40e5cc43cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:30.812910 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c39b2-1855-4e74-9160-6a40e5cc43cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.813193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c39b2-1855-4e74-9160-6a40e5cc43cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.813639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c39b2-1855-4e74-9160-6a40e5cc43cd admin admin] PATH_INFO: `/v3/projects/ef1869eb680943a0ae31ad7ecd1bf50c/users/9ddee54e12fd41d69d8941b572dc2bc7/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.829120 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c39b2-1855-4e74-9160-6a40e5cc43cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1869eb680943a0ae31ad7ecd1bf50c, user_id=9ddee54e12fd41d69d8941b572dc2bc7, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:30.831781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c39b2-1855-4e74-9160-6a40e5cc43cd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:30.844952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1384/2749] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:30 2022] PUT /identity/v3/projects/ef1869eb680943a0ae31ad7ecd1bf50c/users/9ddee54e12fd41d69d8941b572dc2bc7/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:36:30.848872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7be1c-cd08-4ace-929d-db92e7f897c4 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:30.858605 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7be1c-cd08-4ace-929d-db92e7f897c4 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:30.912292 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56eced1-4f65-455a-83b6-457ff59c6212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:30.912879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eced1-4f65-455a-83b6-457ff59c6212 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.913158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eced1-4f65-455a-83b6-457ff59c6212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.913432 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56eced1-4f65-455a-83b6-457ff59c6212 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.914132 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56eced1-4f65-455a-83b6-457ff59c6212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:30.916344 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56eced1-4f65-455a-83b6-457ff59c6212 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:30.926033 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1366/2750] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:36:30.930339 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c39b2-1855-4e74-9160-6a40e5cc43cd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:30.940612 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c39b2-1855-4e74-9160-6a40e5cc43cd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:30.945502 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afc647-d240-4767-80bd-3c10709add8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:30.947676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afc647-d240-4767-80bd-3c10709add8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.947676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afc647-d240-4767-80bd-3c10709add8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.947676 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2afc647-d240-4767-80bd-3c10709add8a admin admin] PATH_INFO: `/v3/projects/ef1869eb680943a0ae31ad7ecd1bf50c/users/9ddee54e12fd41d69d8941b572dc2bc7/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:30.949490 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afc647-d240-4767-80bd-3c10709add8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1869eb680943a0ae31ad7ecd1bf50c, user_id=9ddee54e12fd41d69d8941b572dc2bc7, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:30.952159 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2afc647-d240-4767-80bd-3c10709add8a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:30.962992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1385/2751] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:30 2022] PUT /identity/v3/projects/ef1869eb680943a0ae31ad7ecd1bf50c/users/9ddee54e12fd41d69d8941b572dc2bc7/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:36:30.975160 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25187-1a3d-4236-8314-9a27284d1c45 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:30.975454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25187-1a3d-4236-8314-9a27284d1c45 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:30.975734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d25187-1a3d-4236-8314-9a27284d1c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:31.003787 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-54d25187-1a3d-4236-8314-9a27284d1c45 None None] MFA Rules not processed for user `9ddee54e12fd41d69d8941b572dc2bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:31.005271 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-54d25187-1a3d-4236-8314-9a27284d1c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:31.104435 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1367/2752] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:31.115651 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afc647-d240-4767-80bd-3c10709add8a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:31.119578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e2afc647-d240-4767-80bd-3c10709add8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:31.196319 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2afc647-d240-4767-80bd-3c10709add8a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:31.201329 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9698a-a880-4af7-a817-a7b57b5e8f43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:31.201979 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9698a-a880-4af7-a817-a7b57b5e8f43 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:31.202257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9698a-a880-4af7-a817-a7b57b5e8f43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:31.202528 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9698a-a880-4af7-a817-a7b57b5e8f43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:31.221892 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9698a-a880-4af7-a817-a7b57b5e8f43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:31.226226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9698a-a880-4af7-a817-a7b57b5e8f43 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:31.237110 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1386/2753] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:31 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:31.439685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d25187-1a3d-4236-8314-9a27284d1c45 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:31.512945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d25187-1a3d-4236-8314-9a27284d1c45 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:31.517669 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:31.518574 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:31.518854 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:31.519124 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] PATH_INFO: `/v3/users/b0cc09321ed440c1b5d62340feb7d64c` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:31.520602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0cc09321ed440c1b5d62340feb7d64c)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:31.522499 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:31.577395 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0cc09321ed440c1b5d62340feb7d64c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:31.590060 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0cc09321ed440c1b5d62340feb7d64c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:31.597438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0cc09321ed440c1b5d62340feb7d64c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:31.605531 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0cc09321ed440c1b5d62340feb7d64c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:31.606203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0cc09321ed440c1b5d62340feb7d64c'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:31.612687 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1368/2754] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:36:31 2022] DELETE /identity/v3/users/b0cc09321ed440c1b5d62340feb7d64c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:31.617310 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52cd0-d2bc-47cf-9923-bd1e3833222b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:31.617687 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52cd0-d2bc-47cf-9923-bd1e3833222b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:31.618024 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52cd0-d2bc-47cf-9923-bd1e3833222b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:31.636465 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-baa52cd0-d2bc-47cf-9923-bd1e3833222b None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:31.637809 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-baa52cd0-d2bc-47cf-9923-bd1e3833222b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:31.698644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1387/2755] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:31.709145 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:31.710642 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:31.770162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbdb96-b14d-4b2f-84b6-fb8a2c9839b3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:31.774011 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0a242-6b66-4710-904b-150e8ee7de92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:31.774806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0a242-6b66-4710-904b-150e8ee7de92 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:31.775087 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0a242-6b66-4710-904b-150e8ee7de92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:31.775361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0a242-6b66-4710-904b-150e8ee7de92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:31.785128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0a242-6b66-4710-904b-150e8ee7de92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:31.786615 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0a242-6b66-4710-904b-150e8ee7de92 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:31.797951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1369/2756] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:32.077001 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52cd0-d2bc-47cf-9923-bd1e3833222b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:32.079010 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-baa52cd0-d2bc-47cf-9923-bd1e3833222b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:32.092314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52cd0-d2bc-47cf-9923-bd1e3833222b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:32.097617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:32.098589 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:32.098959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:32.099482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] PATH_INFO: `/v3/projects/4e1710ee3c584ca4894e23f9c0c8a88f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:32.100802 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1710ee3c584ca4894e23f9c0c8a88f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:32.103467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:32.159750 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1710ee3c584ca4894e23f9c0c8a88f', 'request_id': 'req-4d970bf9-3235-4722-b069-37caae5e36df'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.166326 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1710ee3c584ca4894e23f9c0c8a88f', 'request_id': 'req-4d970bf9-3235-4722-b069-37caae5e36df'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.172928 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1710ee3c584ca4894e23f9c0c8a88f', 'request_id': 'req-4d970bf9-3235-4722-b069-37caae5e36df'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.187553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] The token cache is being invalidate because project 4e1710ee3c584ca4894e23f9c0c8a88f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:36:32.187726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.188382 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.190006 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1388/2757] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:36:32 2022] DELETE /identity/v3/projects/4e1710ee3c584ca4894e23f9c0c8a88f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:32.194098 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0a242-6b66-4710-904b-150e8ee7de92 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:32.205027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0a242-6b66-4710-904b-150e8ee7de92 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:32.276870 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc8949-f611-47e1-a069-56474b144858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:32.277976 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc8949-f611-47e1-a069-56474b144858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:32.278464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc8949-f611-47e1-a069-56474b144858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:32.278891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc8949-f611-47e1-a069-56474b144858 admin admin] PATH_INFO: `/v3/users/9ddee54e12fd41d69d8941b572dc2bc7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:32.280303 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc8949-f611-47e1-a069-56474b144858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ddee54e12fd41d69d8941b572dc2bc7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:32.283164 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc8949-f611-47e1-a069-56474b144858 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:32.346626 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b6fc8949-f611-47e1-a069-56474b144858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ddee54e12fd41d69d8941b572dc2bc7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.361694 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b6fc8949-f611-47e1-a069-56474b144858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ddee54e12fd41d69d8941b572dc2bc7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.377044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b6fc8949-f611-47e1-a069-56474b144858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ddee54e12fd41d69d8941b572dc2bc7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.390490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b6fc8949-f611-47e1-a069-56474b144858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ddee54e12fd41d69d8941b572dc2bc7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.391348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-b6fc8949-f611-47e1-a069-56474b144858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ddee54e12fd41d69d8941b572dc2bc7'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.399635 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1370/2758] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:36:32 2022] DELETE /identity/v3/users/9ddee54e12fd41d69d8941b572dc2bc7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:32.733275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:32.734767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:32.760887 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d970bf9-3235-4722-b069-37caae5e36df admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:32.841962 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:32.842847 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:32.843604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:32.843604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f admin admin] PATH_INFO: `/v3/projects/ef1869eb680943a0ae31ad7ecd1bf50c` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:32.847293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1869eb680943a0ae31ad7ecd1bf50c)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:32.849258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:32.915283 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1869eb680943a0ae31ad7ecd1bf50c', 'request_id': 'req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.921403 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1869eb680943a0ae31ad7ecd1bf50c', 'request_id': 'req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.932435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1869eb680943a0ae31ad7ecd1bf50c', 'request_id': 'req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.949639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f admin admin] The token cache is being invalidate because project ef1869eb680943a0ae31ad7ecd1bf50c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:36:32.950254 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.950904 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-84d21b59-36ad-4ecc-bd90-3bfbc7ccee6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:32.952730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1389/2759] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:36:32 2022] DELETE /identity/v3/projects/ef1869eb680943a0ae31ad7ecd1bf50c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:32.957597 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21be2-02c4-4fac-9c77-f182ee7922c6 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:32.957778 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21be2-02c4-4fac-9c77-f182ee7922c6 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:32.958055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21be2-02c4-4fac-9c77-f182ee7922c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:32.979157 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-a2b21be2-02c4-4fac-9c77-f182ee7922c6 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:32.980586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a2b21be2-02c4-4fac-9c77-f182ee7922c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:33.053199 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1371/2760] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:33.061659 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d92bc-4a86-4b04-a784-dbfa4292ee1e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:33.062673 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d92bc-4a86-4b04-a784-dbfa4292ee1e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:33.063123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d92bc-4a86-4b04-a784-dbfa4292ee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:33.084639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-c45d92bc-4a86-4b04-a784-dbfa4292ee1e None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:33.086060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c45d92bc-4a86-4b04-a784-dbfa4292ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:33.097122 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1390/2761] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:33.102268 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b21be2-02c4-4fac-9c77-f182ee7922c6 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:33.113748 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b21be2-02c4-4fac-9c77-f182ee7922c6 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:33.120046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bec0b6-ea1a-4f5a-b22b-6acc63831fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:33.122029 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bec0b6-ea1a-4f5a-b22b-6acc63831fae admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:33.122029 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bec0b6-ea1a-4f5a-b22b-6acc63831fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:33.122029 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bec0b6-ea1a-4f5a-b22b-6acc63831fae admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:33.122638 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bec0b6-ea1a-4f5a-b22b-6acc63831fae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:36:33.123052 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bec0b6-ea1a-4f5a-b22b-6acc63831fae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:33.124970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bec0b6-ea1a-4f5a-b22b-6acc63831fae admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:33.148744 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1372/2762] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:36:33.155035 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d92bc-4a86-4b04-a784-dbfa4292ee1e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:33.160218 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bec0b6-ea1a-4f5a-b22b-6acc63831fae admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:33.162681 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-13bec0b6-ea1a-4f5a-b22b-6acc63831fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:33.167420 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d92bc-4a86-4b04-a784-dbfa4292ee1e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:33.173199 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2bec5-91ce-44f9-a474-fcc150b86cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:33.173862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2bec5-91ce-44f9-a474-fcc150b86cbb admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:33.174319 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2bec5-91ce-44f9-a474-fcc150b86cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:33.174597 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2bec5-91ce-44f9-a474-fcc150b86cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:33.175304 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2bec5-91ce-44f9-a474-fcc150b86cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:33.177414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2bec5-91ce-44f9-a474-fcc150b86cbb admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:33.204269 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1391/2763] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:36:33 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:33.208473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2bec5-91ce-44f9-a474-fcc150b86cbb admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:33.233780 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bec0b6-ea1a-4f5a-b22b-6acc63831fae admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:33.288152 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2bec5-91ce-44f9-a474-fcc150b86cbb admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:33.290899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1152eb-edda-4db9-88f8-43cc7fc342b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:33.291704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1152eb-edda-4db9-88f8-43cc7fc342b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:33.292352 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1152eb-edda-4db9-88f8-43cc7fc342b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:33.292702 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1152eb-edda-4db9-88f8-43cc7fc342b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:33.294495 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8a1152eb-edda-4db9-88f8-43cc7fc342b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:33.295588 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d3ca4-8c1c-4279-9607-10a99501d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:33.296300 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d3ca4-8c1c-4279-9607-10a99501d814 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:33.296591 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d3ca4-8c1c-4279-9607-10a99501d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:33.296860 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d3ca4-8c1c-4279-9607-10a99501d814 admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:33.297611 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d3ca4-8c1c-4279-9607-10a99501d814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:33.306598 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d3ca4-8c1c-4279-9607-10a99501d814 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:33.330523 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1392/2764] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:36:33 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:33.334356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d3ca4-8c1c-4279-9607-10a99501d814 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:33.345816 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d3ca4-8c1c-4279-9607-10a99501d814 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:33.351953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a9a9f-9b31-4fe8-b095-b8e1076189fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:33.353669 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a9a9f-9b31-4fe8-b095-b8e1076189fa admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:33.354166 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a9a9f-9b31-4fe8-b095-b8e1076189fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:33.354572 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a9a9f-9b31-4fe8-b095-b8e1076189fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:33.355920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a9a9f-9b31-4fe8-b095-b8e1076189fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:33.357719 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a9a9f-9b31-4fe8-b095-b8e1076189fa admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:33.369448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1393/2765] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:36:33.374027 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a9a9f-9b31-4fe8-b095-b8e1076189fa admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:33.374584 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1152eb-edda-4db9-88f8-43cc7fc342b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:33.376120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1152eb-edda-4db9-88f8-43cc7fc342b0 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:33.390121 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1373/2766] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:33.397946 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a9a9f-9b31-4fe8-b095-b8e1076189fa admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:33.404569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c3f7c-707e-4429-bd6d-f484d6874fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:33.405242 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c3f7c-707e-4429-bd6d-f484d6874fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:33.405529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c3f7c-707e-4429-bd6d-f484d6874fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:33.405827 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c3f7c-707e-4429-bd6d-f484d6874fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:33.406562 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c3f7c-707e-4429-bd6d-f484d6874fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:33.408856 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c3f7c-707e-4429-bd6d-f484d6874fb1 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:33.421141 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1394/2767] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:36:33.425496 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1152eb-edda-4db9-88f8-43cc7fc342b0 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:33.437346 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1152eb-edda-4db9-88f8-43cc7fc342b0 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:33.445465 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09ee4-2899-4ed0-a398-83945946100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:33.448300 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09ee4-2899-4ed0-a398-83945946100f admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:33.448801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09ee4-2899-4ed0-a398-83945946100f admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:33.449241 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09ee4-2899-4ed0-a398-83945946100f admin admin] PATH_INFO: `/v3/projects/7009adbf114b48ad85e02ffc8af28564/users/58423dfecd7b45a3aa7398a936607093/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:33.482057 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d09ee4-2899-4ed0-a398-83945946100f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7009adbf114b48ad85e02ffc8af28564, user_id=58423dfecd7b45a3aa7398a936607093, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:33.485120 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d09ee4-2899-4ed0-a398-83945946100f admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:33.512661 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1374/2768] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:33 2022] PUT /identity/v3/projects/7009adbf114b48ad85e02ffc8af28564/users/58423dfecd7b45a3aa7398a936607093/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:33.523235 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9ca26-63c1-4a52-8c62-269405168db4 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:33.523678 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9ca26-63c1-4a52-8c62-269405168db4 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:33.525292 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9ca26-63c1-4a52-8c62-269405168db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:33.576436 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-7fc9ca26-63c1-4a52-8c62-269405168db4 None None] MFA Rules not processed for user `58423dfecd7b45a3aa7398a936607093`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:33.578539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-7fc9ca26-63c1-4a52-8c62-269405168db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:33.705038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1395/2769] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:33.709679 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09ee4-2899-4ed0-a398-83945946100f admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:33.787234 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09ee4-2899-4ed0-a398-83945946100f admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:33.792945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f047f85-4653-4412-9acf-d0be524e174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:33.793602 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f047f85-4653-4412-9acf-d0be524e174a admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:33.794058 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f047f85-4653-4412-9acf-d0be524e174a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:33.794490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f047f85-4653-4412-9acf-d0be524e174a admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:33.795345 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f047f85-4653-4412-9acf-d0be524e174a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:33.797524 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f047f85-4653-4412-9acf-d0be524e174a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:33.827750 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1375/2770] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:36:33 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:33.831737 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9ca26-63c1-4a52-8c62-269405168db4 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:33.844473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9ca26-63c1-4a52-8c62-269405168db4 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:33.929829 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a4779-52df-4ddd-ad5e-90d0ae358d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:33.930540 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a4779-52df-4ddd-ad5e-90d0ae358d6d admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:33.930927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a4779-52df-4ddd-ad5e-90d0ae358d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:33.931157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a4779-52df-4ddd-ad5e-90d0ae358d6d admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:33.932056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a4779-52df-4ddd-ad5e-90d0ae358d6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:33.933987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a4779-52df-4ddd-ad5e-90d0ae358d6d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:33.967314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1396/2771] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:36:33 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:33.972227 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f047f85-4653-4412-9acf-d0be524e174a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:33.985669 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f047f85-4653-4412-9acf-d0be524e174a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:33.996630 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b81515-133e-40d1-ba13-2aa56aa5f7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:33.999213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b81515-133e-40d1-ba13-2aa56aa5f7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:33.999213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b81515-133e-40d1-ba13-2aa56aa5f7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:33.999213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b81515-133e-40d1-ba13-2aa56aa5f7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:33.999213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b81515-133e-40d1-ba13-2aa56aa5f7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:34.002255 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b81515-133e-40d1-ba13-2aa56aa5f7d3 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:34.030153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1376/2772] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:36:34.031243 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a4779-52df-4ddd-ad5e-90d0ae358d6d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:34.044123 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a4779-52df-4ddd-ad5e-90d0ae358d6d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:34.052197 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c0c8-2fb6-443e-bd1f-0aecd69abb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:34.054351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c0c8-2fb6-443e-bd1f-0aecd69abb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:34.054520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c0c8-2fb6-443e-bd1f-0aecd69abb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:34.054640 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0c0c8-2fb6-443e-bd1f-0aecd69abb6b admin admin] PATH_INFO: `/v3/projects/51168f4bae7d4705869c9a2136bf6c3a/users/1eb42d3413a146078436eec72e1d878b/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:34.081480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0c0c8-2fb6-443e-bd1f-0aecd69abb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51168f4bae7d4705869c9a2136bf6c3a, user_id=1eb42d3413a146078436eec72e1d878b, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:34.084223 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0c0c8-2fb6-443e-bd1f-0aecd69abb6b admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:34.104225 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1397/2773] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:34 2022] PUT /identity/v3/projects/51168f4bae7d4705869c9a2136bf6c3a/users/1eb42d3413a146078436eec72e1d878b/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:36:34.108969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b81515-133e-40d1-ba13-2aa56aa5f7d3 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:34.127012 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b81515-133e-40d1-ba13-2aa56aa5f7d3 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:34.211529 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa68a40-621f-47bb-aaa5-92d5e41671ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:34.212987 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa68a40-621f-47bb-aaa5-92d5e41671ae admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:34.213363 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa68a40-621f-47bb-aaa5-92d5e41671ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:34.213695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa68a40-621f-47bb-aaa5-92d5e41671ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:34.214857 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa68a40-621f-47bb-aaa5-92d5e41671ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:34.216801 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa68a40-621f-47bb-aaa5-92d5e41671ae admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:34.233722 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1377/2774] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:36:34.241312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c0c8-2fb6-443e-bd1f-0aecd69abb6b admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:34.253672 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0c0c8-2fb6-443e-bd1f-0aecd69abb6b admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:34.261045 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0e850-8f12-47bf-969f-0989905807a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:34.261996 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0e850-8f12-47bf-969f-0989905807a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:34.262205 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0e850-8f12-47bf-969f-0989905807a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:34.262467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0e850-8f12-47bf-969f-0989905807a6 admin admin] PATH_INFO: `/v3/projects/51168f4bae7d4705869c9a2136bf6c3a/users/1eb42d3413a146078436eec72e1d878b/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:34.264795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0e850-8f12-47bf-969f-0989905807a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51168f4bae7d4705869c9a2136bf6c3a, user_id=1eb42d3413a146078436eec72e1d878b, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:34.267491 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0e850-8f12-47bf-969f-0989905807a6 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:34.280953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1398/2775] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:34 2022] PUT /identity/v3/projects/51168f4bae7d4705869c9a2136bf6c3a/users/1eb42d3413a146078436eec72e1d878b/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:34.293966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8257a6-f54c-4b08-9610-edf7745c413f None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:34.294854 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8257a6-f54c-4b08-9610-edf7745c413f None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:34.295140 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8257a6-f54c-4b08-9610-edf7745c413f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:34.325108 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-bb8257a6-f54c-4b08-9610-edf7745c413f None None] MFA Rules not processed for user `1eb42d3413a146078436eec72e1d878b`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:34.326713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-bb8257a6-f54c-4b08-9610-edf7745c413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:34.408046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1378/2776] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:34.418630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0e850-8f12-47bf-969f-0989905807a6 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:34.420830 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-77e0e850-8f12-47bf-969f-0989905807a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:34.485489 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0e850-8f12-47bf-969f-0989905807a6 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:34.489387 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265db4a-dcab-4d1b-9eaa-609259b5e170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:34.490055 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265db4a-dcab-4d1b-9eaa-609259b5e170 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:34.490389 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265db4a-dcab-4d1b-9eaa-609259b5e170 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:34.490616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265db4a-dcab-4d1b-9eaa-609259b5e170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:34.501062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265db4a-dcab-4d1b-9eaa-609259b5e170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:34.502507 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265db4a-dcab-4d1b-9eaa-609259b5e170 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:34.513863 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1399/2777] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:35.936535 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8257a6-f54c-4b08-9610-edf7745c413f None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:36.042891 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8257a6-f54c-4b08-9610-edf7745c413f None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:36.047842 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:36.048761 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:36.049041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:36.049314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] PATH_INFO: `/v3/users/58423dfecd7b45a3aa7398a936607093` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:36.050514 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58423dfecd7b45a3aa7398a936607093)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:36.052729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:36.129712 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58423dfecd7b45a3aa7398a936607093'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:36.156476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58423dfecd7b45a3aa7398a936607093'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:36.161265 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58423dfecd7b45a3aa7398a936607093'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:36.169419 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58423dfecd7b45a3aa7398a936607093'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:36.170244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58423dfecd7b45a3aa7398a936607093'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:36.176276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1379/2778] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:36:35 2022] DELETE /identity/v3/users/58423dfecd7b45a3aa7398a936607093 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:36.180998 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774645b7-2f05-4d96-b2f3-abbb2092122e None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:36.181617 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774645b7-2f05-4d96-b2f3-abbb2092122e None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:36.181987 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774645b7-2f05-4d96-b2f3-abbb2092122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:36.201899 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-774645b7-2f05-4d96-b2f3-abbb2092122e None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:36.203253 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-774645b7-2f05-4d96-b2f3-abbb2092122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:36.262406 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1400/2779] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:36:36.272168 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:36.273620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:36.342142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eef0c-5f78-45b7-8f74-be5a1e7eeb83 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:36.347320 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd12ed-7c6f-48c3-b2df-9cc71bab09e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:36.347980 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd12ed-7c6f-48c3-b2df-9cc71bab09e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:36.348460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd12ed-7c6f-48c3-b2df-9cc71bab09e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:36.348859 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd12ed-7c6f-48c3-b2df-9cc71bab09e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:36.359582 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd12ed-7c6f-48c3-b2df-9cc71bab09e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:36.361072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd12ed-7c6f-48c3-b2df-9cc71bab09e2 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:36.372873 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1380/2780] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:37.048508 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774645b7-2f05-4d96-b2f3-abbb2092122e None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:37.052579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-774645b7-2f05-4d96-b2f3-abbb2092122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:37.074872 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774645b7-2f05-4d96-b2f3-abbb2092122e None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:37.079890 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:37.082220 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:37.083784 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:37.084201 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] PATH_INFO: `/v3/projects/7009adbf114b48ad85e02ffc8af28564` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:37.085677 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7009adbf114b48ad85e02ffc8af28564)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:37.089624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:37.154025 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7009adbf114b48ad85e02ffc8af28564', 'request_id': 'req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:37.162696 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7009adbf114b48ad85e02ffc8af28564', 'request_id': 'req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:37.176146 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7009adbf114b48ad85e02ffc8af28564', 'request_id': 'req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:37.191832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] The token cache is being invalidate because project 7009adbf114b48ad85e02ffc8af28564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:36:37.192723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:37.193832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:37.196151 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1401/2781] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:36:37 2022] DELETE /identity/v3/projects/7009adbf114b48ad85e02ffc8af28564 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:37.200711 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd12ed-7c6f-48c3-b2df-9cc71bab09e2 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:37.212760 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd12ed-7c6f-48c3-b2df-9cc71bab09e2 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:37.288454 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75600d79-d257-4e0c-91af-8747386fd194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:37.290607 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75600d79-d257-4e0c-91af-8747386fd194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:37.291072 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75600d79-d257-4e0c-91af-8747386fd194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:37.291540 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75600d79-d257-4e0c-91af-8747386fd194 admin admin] PATH_INFO: `/v3/users/1eb42d3413a146078436eec72e1d878b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:37.294870 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75600d79-d257-4e0c-91af-8747386fd194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb42d3413a146078436eec72e1d878b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:37.298202 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75600d79-d257-4e0c-91af-8747386fd194 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:37.384064 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-75600d79-d257-4e0c-91af-8747386fd194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb42d3413a146078436eec72e1d878b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:37.409069 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-75600d79-d257-4e0c-91af-8747386fd194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb42d3413a146078436eec72e1d878b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:37.418593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-75600d79-d257-4e0c-91af-8747386fd194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb42d3413a146078436eec72e1d878b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:37.425926 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-75600d79-d257-4e0c-91af-8747386fd194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb42d3413a146078436eec72e1d878b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:37.427123 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-75600d79-d257-4e0c-91af-8747386fd194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb42d3413a146078436eec72e1d878b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:37.437956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1381/2782] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:36:37 2022] DELETE /identity/v3/users/1eb42d3413a146078436eec72e1d878b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:37.768276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:37.769819 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:37.790109 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d4617-5cda-4ae0-8b0b-d4aa83641f26 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:37.885227 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55da813-11e4-4fda-b917-18d1cfbb756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:37.886541 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55da813-11e4-4fda-b917-18d1cfbb756a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:37.887462 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55da813-11e4-4fda-b917-18d1cfbb756a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:37.888604 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55da813-11e4-4fda-b917-18d1cfbb756a admin admin] PATH_INFO: `/v3/projects/51168f4bae7d4705869c9a2136bf6c3a` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:37.890494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55da813-11e4-4fda-b917-18d1cfbb756a admin admin] RBAC: Authorizing `identity:delete_project(project_id=51168f4bae7d4705869c9a2136bf6c3a)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:37.892694 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55da813-11e4-4fda-b917-18d1cfbb756a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:37.970843 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e55da813-11e4-4fda-b917-18d1cfbb756a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51168f4bae7d4705869c9a2136bf6c3a', 'request_id': 'req-e55da813-11e4-4fda-b917-18d1cfbb756a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:37.979445 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e55da813-11e4-4fda-b917-18d1cfbb756a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51168f4bae7d4705869c9a2136bf6c3a', 'request_id': 'req-e55da813-11e4-4fda-b917-18d1cfbb756a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:37.990993 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e55da813-11e4-4fda-b917-18d1cfbb756a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51168f4bae7d4705869c9a2136bf6c3a', 'request_id': 'req-e55da813-11e4-4fda-b917-18d1cfbb756a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:38.008882 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e55da813-11e4-4fda-b917-18d1cfbb756a admin admin] The token cache is being invalidate because project 51168f4bae7d4705869c9a2136bf6c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:36:38.009454 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e55da813-11e4-4fda-b917-18d1cfbb756a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:38.010482 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-e55da813-11e4-4fda-b917-18d1cfbb756a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:38.012727 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1402/2783] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:36:37 2022] DELETE /identity/v3/projects/51168f4bae7d4705869c9a2136bf6c3a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:38.017364 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70edd92-8b45-4815-b208-2ed547ac3d74 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.017966 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70edd92-8b45-4815-b208-2ed547ac3d74 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.018439 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70edd92-8b45-4815-b208-2ed547ac3d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.039631 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-f70edd92-8b45-4815-b208-2ed547ac3d74 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:38.041479 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-f70edd92-8b45-4815-b208-2ed547ac3d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:38.105852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1382/2784] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:38.113489 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c53516-c4f7-493d-9485-6fe80ab2ff19 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.113949 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c53516-c4f7-493d-9485-6fe80ab2ff19 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.114299 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c53516-c4f7-493d-9485-6fe80ab2ff19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.133877 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-59c53516-c4f7-493d-9485-6fe80ab2ff19 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:38.135206 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-59c53516-c4f7-493d-9485-6fe80ab2ff19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:38.143259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1403/2785] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:38.147751 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70edd92-8b45-4815-b208-2ed547ac3d74 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:38.158370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70edd92-8b45-4815-b208-2ed547ac3d74 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:38.163018 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0056791-d415-4c90-8920-10845e5e5baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:38.163698 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0056791-d415-4c90-8920-10845e5e5baa admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.163978 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0056791-d415-4c90-8920-10845e5e5baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.164282 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0056791-d415-4c90-8920-10845e5e5baa admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.164999 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0056791-d415-4c90-8920-10845e5e5baa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:36:38.165872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0056791-d415-4c90-8920-10845e5e5baa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:38.168434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0056791-d415-4c90-8920-10845e5e5baa admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:38.179977 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1383/2786] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:36:38.184730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c53516-c4f7-493d-9485-6fe80ab2ff19 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:38.193867 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c53516-c4f7-493d-9485-6fe80ab2ff19 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:38.199503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0873eb-c1ee-4ec3-be6e-12ce4b3057c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:38.200278 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0873eb-c1ee-4ec3-be6e-12ce4b3057c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.200627 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0873eb-c1ee-4ec3-be6e-12ce4b3057c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.200967 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0873eb-c1ee-4ec3-be6e-12ce4b3057c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.201730 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0873eb-c1ee-4ec3-be6e-12ce4b3057c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:38.203706 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0873eb-c1ee-4ec3-be6e-12ce4b3057c9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:38.232680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1404/2787] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:36:38 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:38.236851 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0056791-d415-4c90-8920-10845e5e5baa admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:38.248243 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0056791-d415-4c90-8920-10845e5e5baa admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:38.313299 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8708f6-e380-46b9-8e6d-420b6aa3df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:38.313896 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8708f6-e380-46b9-8e6d-420b6aa3df2a admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.314177 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8708f6-e380-46b9-8e6d-420b6aa3df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.314446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8708f6-e380-46b9-8e6d-420b6aa3df2a admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.315151 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8708f6-e380-46b9-8e6d-420b6aa3df2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:38.317132 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8708f6-e380-46b9-8e6d-420b6aa3df2a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:38.338782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1384/2788] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:36:38 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:36:38.342920 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0873eb-c1ee-4ec3-be6e-12ce4b3057c9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:38.354097 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0873eb-c1ee-4ec3-be6e-12ce4b3057c9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:38.359246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a688eb-445c-4765-8718-83a3c82ad4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:38.359999 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a688eb-445c-4765-8718-83a3c82ad4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.360388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a688eb-445c-4765-8718-83a3c82ad4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.360697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a688eb-445c-4765-8718-83a3c82ad4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.361727 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a688eb-445c-4765-8718-83a3c82ad4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:38.363951 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a688eb-445c-4765-8718-83a3c82ad4c9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:38.375698 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1405/2789] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:36:38.380905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8708f6-e380-46b9-8e6d-420b6aa3df2a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:38.391754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8708f6-e380-46b9-8e6d-420b6aa3df2a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:38.396899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdcd53-eabd-4132-b902-20481fd9f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:38.397595 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdcd53-eabd-4132-b902-20481fd9f057 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.397938 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdcd53-eabd-4132-b902-20481fd9f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.398267 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdcd53-eabd-4132-b902-20481fd9f057 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.399084 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdcd53-eabd-4132-b902-20481fd9f057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:38.401647 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdcd53-eabd-4132-b902-20481fd9f057 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:38.412699 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1385/2790] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:36:38.419970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a688eb-445c-4765-8718-83a3c82ad4c9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:38.432434 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a688eb-445c-4765-8718-83a3c82ad4c9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:38.438625 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46f66c-29bd-4817-a78b-e3f7cb08ceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:38.439615 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46f66c-29bd-4817-a78b-e3f7cb08ceed admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.439832 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46f66c-29bd-4817-a78b-e3f7cb08ceed admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.440154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46f66c-29bd-4817-a78b-e3f7cb08ceed admin admin] PATH_INFO: `/v3/projects/a698fab8dbed49458c3472216ccd1ab2/users/f26c21a2328240a9b0e846fa147d634b/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.459145 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46f66c-29bd-4817-a78b-e3f7cb08ceed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a698fab8dbed49458c3472216ccd1ab2, user_id=f26c21a2328240a9b0e846fa147d634b, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:38.462813 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46f66c-29bd-4817-a78b-e3f7cb08ceed admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:38.479671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1406/2791] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:38 2022] PUT /identity/v3/projects/a698fab8dbed49458c3472216ccd1ab2/users/f26c21a2328240a9b0e846fa147d634b/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:38.491367 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285adc27-69a2-47c4-aff3-d77c650dbf80 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.491998 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285adc27-69a2-47c4-aff3-d77c650dbf80 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.492338 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285adc27-69a2-47c4-aff3-d77c650dbf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.520783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-285adc27-69a2-47c4-aff3-d77c650dbf80 None None] MFA Rules not processed for user `f26c21a2328240a9b0e846fa147d634b`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:38.521972 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-285adc27-69a2-47c4-aff3-d77c650dbf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:38.604203 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1386/2792] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:36:38.608954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46f66c-29bd-4817-a78b-e3f7cb08ceed admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:38.676154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46f66c-29bd-4817-a78b-e3f7cb08ceed admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:38.681914 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130043-a51e-4dad-8637-99adc485ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:38.682710 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130043-a51e-4dad-8637-99adc485ac08 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.683100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130043-a51e-4dad-8637-99adc485ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.683488 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130043-a51e-4dad-8637-99adc485ac08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.684430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130043-a51e-4dad-8637-99adc485ac08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:38.686672 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130043-a51e-4dad-8637-99adc485ac08 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:38.717930 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1407/2793] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:36:38 2022] POST /identity/v3/projects => generated 399 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:38.721767 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285adc27-69a2-47c4-aff3-d77c650dbf80 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:38.734878 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285adc27-69a2-47c4-aff3-d77c650dbf80 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:38.799759 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfbdbb-2eda-4e97-bae1-d6f9d0808e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:38.800964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfbdbb-2eda-4e97-bae1-d6f9d0808e86 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.800964 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfbdbb-2eda-4e97-bae1-d6f9d0808e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.801236 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfbdbb-2eda-4e97-bae1-d6f9d0808e86 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.802150 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfbdbb-2eda-4e97-bae1-d6f9d0808e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:38.804182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfbdbb-2eda-4e97-bae1-d6f9d0808e86 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:38.832344 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1387/2794] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:36:38 2022] POST /identity/v3/users => generated 306 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:36:38.836563 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130043-a51e-4dad-8637-99adc485ac08 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:38.848293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130043-a51e-4dad-8637-99adc485ac08 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:38.855806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639646b-15c9-4ce3-bb1f-af54a9fab79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:38.856599 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639646b-15c9-4ce3-bb1f-af54a9fab79e admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.856956 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639646b-15c9-4ce3-bb1f-af54a9fab79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.857688 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639646b-15c9-4ce3-bb1f-af54a9fab79e admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.858198 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639646b-15c9-4ce3-bb1f-af54a9fab79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:38.860060 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639646b-15c9-4ce3-bb1f-af54a9fab79e admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:38.876074 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1408/2795] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:36:38.878504 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfbdbb-2eda-4e97-bae1-d6f9d0808e86 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:38.889500 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfbdbb-2eda-4e97-bae1-d6f9d0808e86 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:38.894650 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386e6c4-54ed-4f43-b078-50731bf60b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:38.895538 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386e6c4-54ed-4f43-b078-50731bf60b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:38.895816 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386e6c4-54ed-4f43-b078-50731bf60b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:38.896119 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386e6c4-54ed-4f43-b078-50731bf60b3d admin admin] PATH_INFO: `/v3/projects/3d15376327d546f38425364a3d375dcb/users/6a1a08805560419bb72c7ce0aff9d5c4/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:38.912922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386e6c4-54ed-4f43-b078-50731bf60b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d15376327d546f38425364a3d375dcb, user_id=6a1a08805560419bb72c7ce0aff9d5c4, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:38.915827 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386e6c4-54ed-4f43-b078-50731bf60b3d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:38.930521 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1388/2796] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:38 2022] PUT /identity/v3/projects/3d15376327d546f38425364a3d375dcb/users/6a1a08805560419bb72c7ce0aff9d5c4/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:36:38.935226 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639646b-15c9-4ce3-bb1f-af54a9fab79e admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:38.945173 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639646b-15c9-4ce3-bb1f-af54a9fab79e admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:39.001033 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec368ff-2417-46d0-a373-61d87aa22469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:39.001574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec368ff-2417-46d0-a373-61d87aa22469 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:39.001862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec368ff-2417-46d0-a373-61d87aa22469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:39.002257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec368ff-2417-46d0-a373-61d87aa22469 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:39.002852 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec368ff-2417-46d0-a373-61d87aa22469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:39.004486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec368ff-2417-46d0-a373-61d87aa22469 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:39.015702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1409/2797] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:36:39.019854 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386e6c4-54ed-4f43-b078-50731bf60b3d admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:39.035623 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386e6c4-54ed-4f43-b078-50731bf60b3d admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:39.041517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07c9a7-cbd9-487d-b5bd-e6a8b4597413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:39.042605 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07c9a7-cbd9-487d-b5bd-e6a8b4597413 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:39.042995 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07c9a7-cbd9-487d-b5bd-e6a8b4597413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:39.043158 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c07c9a7-cbd9-487d-b5bd-e6a8b4597413 admin admin] PATH_INFO: `/v3/projects/3d15376327d546f38425364a3d375dcb/users/6a1a08805560419bb72c7ce0aff9d5c4/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:39.045215 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07c9a7-cbd9-487d-b5bd-e6a8b4597413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d15376327d546f38425364a3d375dcb, user_id=6a1a08805560419bb72c7ce0aff9d5c4, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:39.047877 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c07c9a7-cbd9-487d-b5bd-e6a8b4597413 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:39.060000 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1389/2798] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:39 2022] PUT /identity/v3/projects/3d15376327d546f38425364a3d375dcb/users/6a1a08805560419bb72c7ce0aff9d5c4/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:39.071450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef96802-9408-4547-9285-e75683925ab1 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:39.071921 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef96802-9408-4547-9285-e75683925ab1 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:39.072530 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef96802-9408-4547-9285-e75683925ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:39.101324 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-0ef96802-9408-4547-9285-e75683925ab1 None None] MFA Rules not processed for user `6a1a08805560419bb72c7ce0aff9d5c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:39.102622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-0ef96802-9408-4547-9285-e75683925ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:39.179990 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1410/2799] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:39 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:39.190648 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07c9a7-cbd9-487d-b5bd-e6a8b4597413 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:39.192676 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-2c07c9a7-cbd9-487d-b5bd-e6a8b4597413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:39.249483 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c07c9a7-cbd9-487d-b5bd-e6a8b4597413 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:39.253324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f8e9-db70-43d3-a4b4-1aaaf9e79656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:39.253960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f8e9-db70-43d3-a4b4-1aaaf9e79656 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:39.254239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f8e9-db70-43d3-a4b4-1aaaf9e79656 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:39.254509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86f8e9-db70-43d3-a4b4-1aaaf9e79656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:39.264387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86f8e9-db70-43d3-a4b4-1aaaf9e79656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:39.265824 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86f8e9-db70-43d3-a4b4-1aaaf9e79656 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:39.277445 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1390/2800] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:39 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:36:39.351067 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef96802-9408-4547-9285-e75683925ab1 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:39.361355 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef96802-9408-4547-9285-e75683925ab1 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:39.364929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018f3d8-ed94-4534-b01f-9c2c74c7117f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:39.365586 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018f3d8-ed94-4534-b01f-9c2c74c7117f service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:39.365866 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018f3d8-ed94-4534-b01f-9c2c74c7117f service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:39.366140 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018f3d8-ed94-4534-b01f-9c2c74c7117f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:39.423970 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018f3d8-ed94-4534-b01f-9c2c74c7117f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:39.425435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018f3d8-ed94-4534-b01f-9c2c74c7117f service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:39.435079 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1411/2801] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:36:43.462671 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f8e9-db70-43d3-a4b4-1aaaf9e79656 service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:43.523418 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86f8e9-db70-43d3-a4b4-1aaaf9e79656 service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:43.528695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:43.529551 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:43.529825 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:43.530093 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] PATH_INFO: `/v3/users/f26c21a2328240a9b0e846fa147d634b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:43.531476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26c21a2328240a9b0e846fa147d634b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:43.535036 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:43.595580 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26c21a2328240a9b0e846fa147d634b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:43.608312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26c21a2328240a9b0e846fa147d634b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:43.615573 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26c21a2328240a9b0e846fa147d634b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:43.623142 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26c21a2328240a9b0e846fa147d634b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:43.623764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26c21a2328240a9b0e846fa147d634b'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:43.629446 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1391/2802] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:36:43 2022] DELETE /identity/v3/users/f26c21a2328240a9b0e846fa147d634b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:43.634644 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb4e3b-fd4f-4a13-9660-2617e3c9ede8 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:43.635409 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb4e3b-fd4f-4a13-9660-2617e3c9ede8 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:43.635409 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb4e3b-fd4f-4a13-9660-2617e3c9ede8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:43.651428 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-5bbb4e3b-fd4f-4a13-9660-2617e3c9ede8 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:43.652636 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5bbb4e3b-fd4f-4a13-9660-2617e3c9ede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:43.709814 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1412/2803] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:43.720248 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:43.721658 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:43.778844 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233a58d-ae10-4d43-93ec-157df3a2c89c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:43.782508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5f90e-6f93-4ede-be49-8c1ee5282c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:43.783147 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5f90e-6f93-4ede-be49-8c1ee5282c0b service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:43.783457 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5f90e-6f93-4ede-be49-8c1ee5282c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:43.783733 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5f90e-6f93-4ede-be49-8c1ee5282c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:43.793600 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5f90e-6f93-4ede-be49-8c1ee5282c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:43.795029 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5f90e-6f93-4ede-be49-8c1ee5282c0b service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:43.805221 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1392/2804] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:44.062874 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb4e3b-fd4f-4a13-9660-2617e3c9ede8 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:44.064373 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-5bbb4e3b-fd4f-4a13-9660-2617e3c9ede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:44.078193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb4e3b-fd4f-4a13-9660-2617e3c9ede8 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:44.082781 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:44.084203 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:44.084700 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:44.084977 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] PATH_INFO: `/v3/projects/a698fab8dbed49458c3472216ccd1ab2` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:44.086156 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a698fab8dbed49458c3472216ccd1ab2)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:44.088351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:44.133073 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a698fab8dbed49458c3472216ccd1ab2', 'request_id': 'req-d5435999-0f63-4380-ae69-ac763ffba5b0'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.139020 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a698fab8dbed49458c3472216ccd1ab2', 'request_id': 'req-d5435999-0f63-4380-ae69-ac763ffba5b0'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.144997 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a698fab8dbed49458c3472216ccd1ab2', 'request_id': 'req-d5435999-0f63-4380-ae69-ac763ffba5b0'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.156684 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] The token cache is being invalidate because project a698fab8dbed49458c3472216ccd1ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:36:44.156972 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.157593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.159116 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1413/2805] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:36:44 2022] DELETE /identity/v3/projects/a698fab8dbed49458c3472216ccd1ab2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:44.163128 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5f90e-6f93-4ede-be49-8c1ee5282c0b service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:44.173106 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5f90e-6f93-4ede-be49-8c1ee5282c0b service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:44.229840 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8a59d-59f7-4b35-b14c-f404592e647c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:44.230695 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a59d-59f7-4b35-b14c-f404592e647c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:44.230997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a59d-59f7-4b35-b14c-f404592e647c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:44.231270 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8a59d-59f7-4b35-b14c-f404592e647c admin admin] PATH_INFO: `/v3/users/6a1a08805560419bb72c7ce0aff9d5c4` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:44.232463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8a59d-59f7-4b35-b14c-f404592e647c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a1a08805560419bb72c7ce0aff9d5c4)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:44.234359 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8a59d-59f7-4b35-b14c-f404592e647c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:44.279104 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e8d8a59d-59f7-4b35-b14c-f404592e647c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a1a08805560419bb72c7ce0aff9d5c4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.290441 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e8d8a59d-59f7-4b35-b14c-f404592e647c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a1a08805560419bb72c7ce0aff9d5c4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.297883 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e8d8a59d-59f7-4b35-b14c-f404592e647c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a1a08805560419bb72c7ce0aff9d5c4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.304852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e8d8a59d-59f7-4b35-b14c-f404592e647c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a1a08805560419bb72c7ce0aff9d5c4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.305476 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-e8d8a59d-59f7-4b35-b14c-f404592e647c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a1a08805560419bb72c7ce0aff9d5c4'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.311877 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1393/2806] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:36:44 2022] DELETE /identity/v3/users/6a1a08805560419bb72c7ce0aff9d5c4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:44.611957 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:44.613421 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:44.627163 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5435999-0f63-4380-ae69-ac763ffba5b0 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:44.683605 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373131b8-85f5-406b-8285-a94031a9b459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:44.684490 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373131b8-85f5-406b-8285-a94031a9b459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:44.684773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373131b8-85f5-406b-8285-a94031a9b459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:44.685047 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373131b8-85f5-406b-8285-a94031a9b459 admin admin] PATH_INFO: `/v3/projects/3d15376327d546f38425364a3d375dcb` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:44.686234 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373131b8-85f5-406b-8285-a94031a9b459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d15376327d546f38425364a3d375dcb)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:44.688164 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373131b8-85f5-406b-8285-a94031a9b459 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:44.732403 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-373131b8-85f5-406b-8285-a94031a9b459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d15376327d546f38425364a3d375dcb', 'request_id': 'req-373131b8-85f5-406b-8285-a94031a9b459'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.737447 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-373131b8-85f5-406b-8285-a94031a9b459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d15376327d546f38425364a3d375dcb', 'request_id': 'req-373131b8-85f5-406b-8285-a94031a9b459'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.743286 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-373131b8-85f5-406b-8285-a94031a9b459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d15376327d546f38425364a3d375dcb', 'request_id': 'req-373131b8-85f5-406b-8285-a94031a9b459'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.755668 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-373131b8-85f5-406b-8285-a94031a9b459 admin admin] The token cache is being invalidate because project 3d15376327d546f38425364a3d375dcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:36:44.755953 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-373131b8-85f5-406b-8285-a94031a9b459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.756610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-373131b8-85f5-406b-8285-a94031a9b459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:36:44.758113 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1414/2807] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:36:44 2022] DELETE /identity/v3/projects/3d15376327d546f38425364a3d375dcb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:36:44.763545 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e9b2c-b7d4-4218-abd1-dca7caec6694 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:44.764041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e9b2c-b7d4-4218-abd1-dca7caec6694 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:44.764160 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e9b2c-b7d4-4218-abd1-dca7caec6694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:44.782374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-4b4e9b2c-b7d4-4218-abd1-dca7caec6694 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:44.783562 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4b4e9b2c-b7d4-4218-abd1-dca7caec6694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:44.842820 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1394/2808] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 09:36:44.850724 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5567c5-4f85-44b5-8da7-43f5d40f7e6d None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:44.851020 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5567c5-4f85-44b5-8da7-43f5d40f7e6d None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:44.851305 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5567c5-4f85-44b5-8da7-43f5d40f7e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:44.870120 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-8e5567c5-4f85-44b5-8da7-43f5d40f7e6d None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:44.871309 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-8e5567c5-4f85-44b5-8da7-43f5d40f7e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:44.879177 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1415/2809] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:44.883384 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e9b2c-b7d4-4218-abd1-dca7caec6694 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:44.892907 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e9b2c-b7d4-4218-abd1-dca7caec6694 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:44.897463 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac9f88-fc0c-468e-a622-7928b9d56357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:44.898103 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac9f88-fc0c-468e-a622-7928b9d56357 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:44.898383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac9f88-fc0c-468e-a622-7928b9d56357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:44.898656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac9f88-fc0c-468e-a622-7928b9d56357 admin admin] PATH_INFO: `/v3/domains` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:44.899369 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac9f88-fc0c-468e-a622-7928b9d56357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:36:44.900217 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac9f88-fc0c-468e-a622-7928b9d56357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:44.901803 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac9f88-fc0c-468e-a622-7928b9d56357 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:44.912808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1395/2810] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:36:44.918187 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5567c5-4f85-44b5-8da7-43f5d40f7e6d None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:44.927268 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5567c5-4f85-44b5-8da7-43f5d40f7e6d None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:44.932450 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66def9-a41e-4a29-bb31-ee892674becd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:44.933098 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66def9-a41e-4a29-bb31-ee892674becd admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:44.933381 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66def9-a41e-4a29-bb31-ee892674becd admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:44.933656 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66def9-a41e-4a29-bb31-ee892674becd admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:44.934338 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66def9-a41e-4a29-bb31-ee892674becd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:44.936251 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66def9-a41e-4a29-bb31-ee892674becd admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:44.962663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1416/2811] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:36:44 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:44.966558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac9f88-fc0c-468e-a622-7928b9d56357 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:44.976380 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac9f88-fc0c-468e-a622-7928b9d56357 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:45.032956 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506e995-2c8a-4f6a-adac-677b0d95897a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:45.033624 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506e995-2c8a-4f6a-adac-677b0d95897a admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:45.033905 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506e995-2c8a-4f6a-adac-677b0d95897a admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:45.034182 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506e995-2c8a-4f6a-adac-677b0d95897a admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:45.034880 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506e995-2c8a-4f6a-adac-677b0d95897a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:45.036813 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506e995-2c8a-4f6a-adac-677b0d95897a admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:45.056539 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1396/2812] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:36:44 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:45.061056 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66def9-a41e-4a29-bb31-ee892674becd admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:45.071007 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66def9-a41e-4a29-bb31-ee892674becd admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:45.076332 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a880b1-a08e-4129-8c97-c5576dabb7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:45.076981 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a880b1-a08e-4129-8c97-c5576dabb7fc admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:45.077259 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a880b1-a08e-4129-8c97-c5576dabb7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:45.077534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a880b1-a08e-4129-8c97-c5576dabb7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:45.078250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a880b1-a08e-4129-8c97-c5576dabb7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:45.079823 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a880b1-a08e-4129-8c97-c5576dabb7fc admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:45.090023 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1417/2813] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:36:45.094148 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506e995-2c8a-4f6a-adac-677b0d95897a admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:45.104244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506e995-2c8a-4f6a-adac-677b0d95897a admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:45.109263 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298cf21-0861-4199-9354-03f48b033e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:45.109925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298cf21-0861-4199-9354-03f48b033e25 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:45.110207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298cf21-0861-4199-9354-03f48b033e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:45.110480 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298cf21-0861-4199-9354-03f48b033e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:45.111184 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298cf21-0861-4199-9354-03f48b033e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:45.112815 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298cf21-0861-4199-9354-03f48b033e25 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:45.123357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1397/2814] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:36:45.127507 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a880b1-a08e-4129-8c97-c5576dabb7fc admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:45.142219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a880b1-a08e-4129-8c97-c5576dabb7fc admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:45.146929 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b451b0-cf97-40da-a10e-1c8eaed3b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:45.147794 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b451b0-cf97-40da-a10e-1c8eaed3b243 admin admin] REQUEST_METHOD: `PUT` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:45.148099 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b451b0-cf97-40da-a10e-1c8eaed3b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:45.148372 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b451b0-cf97-40da-a10e-1c8eaed3b243 admin admin] PATH_INFO: `/v3/projects/7a4a8a3770074a429272d67d66509fc9/users/d0ddccfd8799482a88d9d18fe8266fce/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:45.172538 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b451b0-cf97-40da-a10e-1c8eaed3b243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4a8a3770074a429272d67d66509fc9, user_id=d0ddccfd8799482a88d9d18fe8266fce, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:45.175315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b451b0-cf97-40da-a10e-1c8eaed3b243 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:45.189088 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1418/2815] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:45 2022] PUT /identity/v3/projects/7a4a8a3770074a429272d67d66509fc9/users/d0ddccfd8799482a88d9d18fe8266fce/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:36:45.194163 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf858c-e112-4809-8ef7-66caf9426898 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:45.194460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf858c-e112-4809-8ef7-66caf9426898 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:45.194740 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf858c-e112-4809-8ef7-66caf9426898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:45.214567 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-46bf858c-e112-4809-8ef7-66caf9426898 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:45.215764 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-46bf858c-e112-4809-8ef7-66caf9426898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:45.271990 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1398/2816] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:45.282257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b451b0-cf97-40da-a10e-1c8eaed3b243 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:45.283959 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-23b451b0-cf97-40da-a10e-1c8eaed3b243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:45.339195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b451b0-cf97-40da-a10e-1c8eaed3b243 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:45.342878 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe019f-04e1-4a71-b0e1-f54c803e897b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:45.343510 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe019f-04e1-4a71-b0e1-f54c803e897b service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:45.343793 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe019f-04e1-4a71-b0e1-f54c803e897b service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:45.344100 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe019f-04e1-4a71-b0e1-f54c803e897b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:45.353054 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe019f-04e1-4a71-b0e1-f54c803e897b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:45.354553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbe019f-04e1-4a71-b0e1-f54c803e897b service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:45.363733 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1419/2817] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:46.004770 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8360c-01eb-4bc2-8088-83c9e31041e2 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:46.005342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8360c-01eb-4bc2-8088-83c9e31041e2 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:46.005342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8360c-01eb-4bc2-8088-83c9e31041e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:46.034871 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-33c8360c-01eb-4bc2-8088-83c9e31041e2 None None] MFA Rules not processed for user `d0ddccfd8799482a88d9d18fe8266fce`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:46.036620 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-33c8360c-01eb-4bc2-8088-83c9e31041e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:46.102608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1399/2818] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:46.107521 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe019f-04e1-4a71-b0e1-f54c803e897b service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:46.117525 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe019f-04e1-4a71-b0e1-f54c803e897b service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:46.122435 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fed63-5ba8-4ea2-b051-a716a96b1184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:46.123080 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fed63-5ba8-4ea2-b051-a716a96b1184 admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:46.123365 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fed63-5ba8-4ea2-b051-a716a96b1184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:46.123646 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fed63-5ba8-4ea2-b051-a716a96b1184 admin admin] PATH_INFO: `/v3/projects` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:46.124385 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fed63-5ba8-4ea2-b051-a716a96b1184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:46.126287 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fed63-5ba8-4ea2-b051-a716a96b1184 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:46.156093 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1420/2819] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:36:46 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:46.159383 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8360c-01eb-4bc2-8088-83c9e31041e2 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:46.170851 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8360c-01eb-4bc2-8088-83c9e31041e2 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:46.225357 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8dcc-a93c-44fe-b94d-909edfac6602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:46.226023 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8dcc-a93c-44fe-b94d-909edfac6602 admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:46.226300 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8dcc-a93c-44fe-b94d-909edfac6602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:46.226576 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8dcc-a93c-44fe-b94d-909edfac6602 admin admin] PATH_INFO: `/v3/users` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:46.227276 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8dcc-a93c-44fe-b94d-909edfac6602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:46.229922 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8dcc-a93c-44fe-b94d-909edfac6602 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:46.250269 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1400/2820] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:36:46 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:36:46.254528 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fed63-5ba8-4ea2-b051-a716a96b1184 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:46.265691 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fed63-5ba8-4ea2-b051-a716a96b1184 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:46.270445 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442159b2-ab77-4bc8-91ab-72c4398eb044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:46.271650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442159b2-ab77-4bc8-91ab-72c4398eb044 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:46.272542 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442159b2-ab77-4bc8-91ab-72c4398eb044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:46.273160 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442159b2-ab77-4bc8-91ab-72c4398eb044 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:46.274090 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442159b2-ab77-4bc8-91ab-72c4398eb044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:46.276364 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442159b2-ab77-4bc8-91ab-72c4398eb044 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:46.290295 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1421/2821] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 09:36:46.292449 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8dcc-a93c-44fe-b94d-909edfac6602 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:46.302808 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8dcc-a93c-44fe-b94d-909edfac6602 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:46.308829 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7d63a-e7cc-4822-8616-279fca232642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:46.310019 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7d63a-e7cc-4822-8616-279fca232642 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:46.310474 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7d63a-e7cc-4822-8616-279fca232642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:46.310842 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7d63a-e7cc-4822-8616-279fca232642 admin admin] PATH_INFO: `/v3/projects/ce589ccd223747708a4caaf8cdbb8427/users/2776a2b220fd497993ec492bfbd8331a/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:46.326207 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7d63a-e7cc-4822-8616-279fca232642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce589ccd223747708a4caaf8cdbb8427, user_id=2776a2b220fd497993ec492bfbd8331a, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:46.328897 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7d63a-e7cc-4822-8616-279fca232642 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:46.341680 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1401/2822] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:46 2022] PUT /identity/v3/projects/ce589ccd223747708a4caaf8cdbb8427/users/2776a2b220fd497993ec492bfbd8331a/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:46.345600 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442159b2-ab77-4bc8-91ab-72c4398eb044 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:46.355349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442159b2-ab77-4bc8-91ab-72c4398eb044 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:46.409537 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861651b-3eb9-4d35-87b6-e83ec1fd4282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:46.410184 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861651b-3eb9-4d35-87b6-e83ec1fd4282 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:46.410464 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861651b-3eb9-4d35-87b6-e83ec1fd4282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:46.410736 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861651b-3eb9-4d35-87b6-e83ec1fd4282 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:46.411437 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861651b-3eb9-4d35-87b6-e83ec1fd4282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:46.413257 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861651b-3eb9-4d35-87b6-e83ec1fd4282 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:46.423148 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1422/2823] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:36:46.427254 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7d63a-e7cc-4822-8616-279fca232642 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:46.438017 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7d63a-e7cc-4822-8616-279fca232642 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:46.442608 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22c03e-dd64-42d2-a16d-12473bc3cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:46.443461 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22c03e-dd64-42d2-a16d-12473bc3cf28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:46.443737 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22c03e-dd64-42d2-a16d-12473bc3cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:46.444010 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22c03e-dd64-42d2-a16d-12473bc3cf28 admin admin] PATH_INFO: `/v3/projects/ce589ccd223747708a4caaf8cdbb8427/users/2776a2b220fd497993ec492bfbd8331a/roles/0e45946c6336419abb2015d8916e31ca` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:46.445960 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22c03e-dd64-42d2-a16d-12473bc3cf28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce589ccd223747708a4caaf8cdbb8427, user_id=2776a2b220fd497993ec492bfbd8331a, role_id=0e45946c6336419abb2015d8916e31ca)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:46.449228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22c03e-dd64-42d2-a16d-12473bc3cf28 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:46.459151 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1402/2824] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:36:46 2022] PUT /identity/v3/projects/ce589ccd223747708a4caaf8cdbb8427/users/2776a2b220fd497993ec492bfbd8331a/roles/0e45946c6336419abb2015d8916e31ca => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:36:47.128960 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f1d94-d4fa-4b03-a1e5-73105fa02f69 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:47.129479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f1d94-d4fa-4b03-a1e5-73105fa02f69 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:47.129650 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f1d94-d4fa-4b03-a1e5-73105fa02f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:47.157680 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e33f1d94-d4fa-4b03-a1e5-73105fa02f69 None None] MFA Rules not processed for user `2776a2b220fd497993ec492bfbd8331a`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:36:47.158985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e33f1d94-d4fa-4b03-a1e5-73105fa02f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:47.227725 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1423/2825] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:36:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:36:47.237949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22c03e-dd64-42d2-a16d-12473bc3cf28 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:47.239867 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-3b22c03e-dd64-42d2-a16d-12473bc3cf28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:47.296788 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22c03e-dd64-42d2-a16d-12473bc3cf28 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:47.300547 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc3f0-d546-4de2-9527-c0e2db68a190 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:47.301186 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc3f0-d546-4de2-9527-c0e2db68a190 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:47.301466 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc3f0-d546-4de2-9527-c0e2db68a190 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:47.301739 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc3f0-d546-4de2-9527-c0e2db68a190 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:47.357719 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbc3f0-d546-4de2-9527-c0e2db68a190 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:47.359136 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbc3f0-d546-4de2-9527-c0e2db68a190 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:47.369252 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1403/2826] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:48.734865 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f1d94-d4fa-4b03-a1e5-73105fa02f69 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:48.736267 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e33f1d94-d4fa-4b03-a1e5-73105fa02f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:48.747792 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f1d94-d4fa-4b03-a1e5-73105fa02f69 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:48.751264 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b654fc-90fd-4fc0-8d94-84e0f31c2a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:48.751886 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b654fc-90fd-4fc0-8d94-84e0f31c2a96 service cinder] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:48.752197 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b654fc-90fd-4fc0-8d94-84e0f31c2a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:48.752467 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b654fc-90fd-4fc0-8d94-84e0f31c2a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:48.761173 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b654fc-90fd-4fc0-8d94-84e0f31c2a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:48.762581 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b654fc-90fd-4fc0-8d94-84e0f31c2a96 service cinder] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:48.771514 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1424/2827] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:36:49.627995 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc3f0-d546-4de2-9527-c0e2db68a190 service cinder] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:36:49.629434 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4bfbc3f0-d546-4de2-9527-c0e2db68a190 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:49.684702 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc3f0-d546-4de2-9527-c0e2db68a190 service cinder] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:36:49.688404 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86d38b-ad39-46c5-a0eb-0305b82d14a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:36:49.689041 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86d38b-ad39-46c5-a0eb-0305b82d14a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:36:49.689324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86d38b-ad39-46c5-a0eb-0305b82d14a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:36:49.689599 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86d38b-ad39-46c5-a0eb-0305b82d14a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:36:49.691342 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-4e86d38b-ad39-46c5-a0eb-0305b82d14a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:36:49.751162 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86d38b-ad39-46c5-a0eb-0305b82d14a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:36:49.752627 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86d38b-ad39-46c5-a0eb-0305b82d14a4 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:36:49.762540 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1404/2828] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:36:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:37:05.672639 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b654fc-90fd-4fc0-8d94-84e0f31c2a96 service cinder] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:05.744624 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b654fc-90fd-4fc0-8d94-84e0f31c2a96 service cinder] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:05.749325 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:05.750194 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:05.750476 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:05.750748 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] PATH_INFO: `/v3/users/d0ddccfd8799482a88d9d18fe8266fce` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:05.751969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ddccfd8799482a88d9d18fe8266fce)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:05.754035 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:05.805131 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ddccfd8799482a88d9d18fe8266fce'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:05.818767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ddccfd8799482a88d9d18fe8266fce'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:05.820119 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ddccfd8799482a88d9d18fe8266fce'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:05.828117 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ddccfd8799482a88d9d18fe8266fce'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:05.834785 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ddccfd8799482a88d9d18fe8266fce'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:05.840868 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1425/2829] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:37:05 2022] DELETE /identity/v3/users/d0ddccfd8799482a88d9d18fe8266fce => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:37:06.017497 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86d38b-ad39-46c5-a0eb-0305b82d14a4 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:06.029796 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86d38b-ad39-46c5-a0eb-0305b82d14a4 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:06.096320 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:06.097175 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:06.097455 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:06.097729 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] PATH_INFO: `/v3/projects/7a4a8a3770074a429272d67d66509fc9` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:06.098885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a4a8a3770074a429272d67d66509fc9)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:06.100804 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:06.144590 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a4a8a3770074a429272d67d66509fc9', 'request_id': 'req-6b706711-08a0-4389-b9f8-2d65f5e83030'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.150265 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a4a8a3770074a429272d67d66509fc9', 'request_id': 'req-6b706711-08a0-4389-b9f8-2d65f5e83030'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.156468 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a4a8a3770074a429272d67d66509fc9', 'request_id': 'req-6b706711-08a0-4389-b9f8-2d65f5e83030'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.169031 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] The token cache is being invalidate because project 7a4a8a3770074a429272d67d66509fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:37:06.169317 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.169975 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.171649 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1405/2830] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:37:06 2022] DELETE /identity/v3/projects/7a4a8a3770074a429272d67d66509fc9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:37:06.175647 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:06.177084 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:06.189795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec570f4-88c2-40ae-b1e0-5030bd08477a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:06.246634 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110716a-4515-4c2a-9858-44e4f1e58e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:06.248154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110716a-4515-4c2a-9858-44e4f1e58e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:06.248636 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110716a-4515-4c2a-9858-44e4f1e58e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:06.249106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110716a-4515-4c2a-9858-44e4f1e58e62 admin admin] PATH_INFO: `/v3/users/2776a2b220fd497993ec492bfbd8331a` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:06.251072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110716a-4515-4c2a-9858-44e4f1e58e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2776a2b220fd497993ec492bfbd8331a)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:06.254616 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110716a-4515-4c2a-9858-44e4f1e58e62 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:06.304312 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c110716a-4515-4c2a-9858-44e4f1e58e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2776a2b220fd497993ec492bfbd8331a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.317311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c110716a-4515-4c2a-9858-44e4f1e58e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2776a2b220fd497993ec492bfbd8331a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.318022 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c110716a-4515-4c2a-9858-44e4f1e58e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2776a2b220fd497993ec492bfbd8331a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.326712 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c110716a-4515-4c2a-9858-44e4f1e58e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2776a2b220fd497993ec492bfbd8331a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.333889 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-c110716a-4515-4c2a-9858-44e4f1e58e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2776a2b220fd497993ec492bfbd8331a'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.340569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1426/2831] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:37:06 2022] DELETE /identity/v3/users/2776a2b220fd497993ec492bfbd8331a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:37:06.514134 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:06.515559 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:06.529083 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b706711-08a0-4389-b9f8-2d65f5e83030 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:06.585936 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971a2f8-275a-492f-bca1-db7445a4a7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:06.586783 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971a2f8-275a-492f-bca1-db7445a4a7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:06.587611 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971a2f8-275a-492f-bca1-db7445a4a7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:06.588110 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971a2f8-275a-492f-bca1-db7445a4a7bb admin admin] PATH_INFO: `/v3/projects/ce589ccd223747708a4caaf8cdbb8427` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:06.589440 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971a2f8-275a-492f-bca1-db7445a4a7bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce589ccd223747708a4caaf8cdbb8427)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:06.591324 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971a2f8-275a-492f-bca1-db7445a4a7bb admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:06.637451 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c971a2f8-275a-492f-bca1-db7445a4a7bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce589ccd223747708a4caaf8cdbb8427', 'request_id': 'req-c971a2f8-275a-492f-bca1-db7445a4a7bb'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.642594 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c971a2f8-275a-492f-bca1-db7445a4a7bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce589ccd223747708a4caaf8cdbb8427', 'request_id': 'req-c971a2f8-275a-492f-bca1-db7445a4a7bb'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.648478 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c971a2f8-275a-492f-bca1-db7445a4a7bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce589ccd223747708a4caaf8cdbb8427', 'request_id': 'req-c971a2f8-275a-492f-bca1-db7445a4a7bb'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.660755 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c971a2f8-275a-492f-bca1-db7445a4a7bb admin admin] The token cache is being invalidate because project ce589ccd223747708a4caaf8cdbb8427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:37:06.661042 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c971a2f8-275a-492f-bca1-db7445a4a7bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.661725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c971a2f8-275a-492f-bca1-db7445a4a7bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:06.663266 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1406/2832] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:37:06 2022] DELETE /identity/v3/projects/ce589ccd223747708a4caaf8cdbb8427 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:37:06.668704 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7dcb3-a9f8-4fa1-874d-57728493b803 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:06.668995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7dcb3-a9f8-4fa1-874d-57728493b803 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:06.669276 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7dcb3-a9f8-4fa1-874d-57728493b803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:06.687199 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-02a7dcb3-a9f8-4fa1-874d-57728493b803 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:37:06.688479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-02a7dcb3-a9f8-4fa1-874d-57728493b803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:06.745070 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1427/2833] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:37:06.752991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892db53-941b-4bfb-8ea6-1ac7b63a50ba None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:06.753280 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892db53-941b-4bfb-8ea6-1ac7b63a50ba None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:06.753556 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892db53-941b-4bfb-8ea6-1ac7b63a50ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:06.772266 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-9892db53-941b-4bfb-8ea6-1ac7b63a50ba None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:37:06.773455 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-9892db53-941b-4bfb-8ea6-1ac7b63a50ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:06.781915 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1407/2834] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:37:06.786017 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7dcb3-a9f8-4fa1-874d-57728493b803 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:06.795815 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7dcb3-a9f8-4fa1-874d-57728493b803 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:06.800416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78437f2-b9d3-4d10-ac93-460bc785e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:06.801061 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78437f2-b9d3-4d10-ac93-460bc785e705 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:06.801343 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78437f2-b9d3-4d10-ac93-460bc785e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:06.801619 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78437f2-b9d3-4d10-ac93-460bc785e705 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:06.802367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78437f2-b9d3-4d10-ac93-460bc785e705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:37:06.802674 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78437f2-b9d3-4d10-ac93-460bc785e705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:06.804290 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78437f2-b9d3-4d10-ac93-460bc785e705 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:06.816106 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1428/2835] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:37:06.820300 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892db53-941b-4bfb-8ea6-1ac7b63a50ba None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:06.829970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892db53-941b-4bfb-8ea6-1ac7b63a50ba None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:06.834626 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34809a96-60b2-49ee-ab27-04c3e9f4581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:06.835260 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34809a96-60b2-49ee-ab27-04c3e9f4581c admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:06.835539 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34809a96-60b2-49ee-ab27-04c3e9f4581c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:06.835812 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34809a96-60b2-49ee-ab27-04c3e9f4581c admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:06.836526 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34809a96-60b2-49ee-ab27-04c3e9f4581c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:06.838501 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34809a96-60b2-49ee-ab27-04c3e9f4581c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:06.862284 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1408/2836] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:37:06 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:37:06.866367 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78437f2-b9d3-4d10-ac93-460bc785e705 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:06.876630 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78437f2-b9d3-4d10-ac93-460bc785e705 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:06.932298 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f586513-9f6e-4ecc-9147-dd13ec2de69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:06.932942 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f586513-9f6e-4ecc-9147-dd13ec2de69c admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:06.933228 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f586513-9f6e-4ecc-9147-dd13ec2de69c admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:06.933506 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f586513-9f6e-4ecc-9147-dd13ec2de69c admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:06.934218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f586513-9f6e-4ecc-9147-dd13ec2de69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:06.936154 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f586513-9f6e-4ecc-9147-dd13ec2de69c admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:06.955520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1429/2837] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:37:06 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:37:06.959593 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34809a96-60b2-49ee-ab27-04c3e9f4581c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:06.969700 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34809a96-60b2-49ee-ab27-04c3e9f4581c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:06.974312 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f9bce-db07-426c-af60-4b275f3f7f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:06.974952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f9bce-db07-426c-af60-4b275f3f7f4c admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:06.975231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f9bce-db07-426c-af60-4b275f3f7f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:06.975502 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f9bce-db07-426c-af60-4b275f3f7f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:06.976239 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f9bce-db07-426c-af60-4b275f3f7f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:06.978380 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f9bce-db07-426c-af60-4b275f3f7f4c admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:06.988411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1409/2838] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:37:06.992172 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f586513-9f6e-4ecc-9147-dd13ec2de69c admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:07.002805 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f586513-9f6e-4ecc-9147-dd13ec2de69c admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:07.007539 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add69480-aa72-4f13-9fa7-84244800650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:07.008218 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69480-aa72-4f13-9fa7-84244800650a admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:07.008520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69480-aa72-4f13-9fa7-84244800650a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:07.008818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69480-aa72-4f13-9fa7-84244800650a admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:07.009575 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add69480-aa72-4f13-9fa7-84244800650a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:07.011155 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add69480-aa72-4f13-9fa7-84244800650a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:07.021046 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1430/2839] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:37:07.025979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f9bce-db07-426c-af60-4b275f3f7f4c admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:07.036130 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f9bce-db07-426c-af60-4b275f3f7f4c admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:07.041806 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2480bf-0cdb-4be8-86a8-ee3d36123cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:07.042677 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2480bf-0cdb-4be8-86a8-ee3d36123cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:07.042958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2480bf-0cdb-4be8-86a8-ee3d36123cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:07.043232 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2480bf-0cdb-4be8-86a8-ee3d36123cc6 admin admin] PATH_INFO: `/v3/projects/dc0dfddd2fb54e0d859e11e40aaeb15d/users/921521d3ee17401c9e1e635c58d1e2ba/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:07.058753 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2480bf-0cdb-4be8-86a8-ee3d36123cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc0dfddd2fb54e0d859e11e40aaeb15d, user_id=921521d3ee17401c9e1e635c58d1e2ba, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:07.061437 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2480bf-0cdb-4be8-86a8-ee3d36123cc6 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:07.074055 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1410/2840] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:37:07 2022] PUT /identity/v3/projects/dc0dfddd2fb54e0d859e11e40aaeb15d/users/921521d3ee17401c9e1e635c58d1e2ba/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:37:07.085410 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e4b43-1093-46c9-b230-5504319f5b63 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:07.085703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e4b43-1093-46c9-b230-5504319f5b63 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:07.085985 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e4b43-1093-46c9-b230-5504319f5b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:07.114213 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-e76e4b43-1093-46c9-b230-5504319f5b63 None None] MFA Rules not processed for user `921521d3ee17401c9e1e635c58d1e2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:37:07.115416 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-e76e4b43-1093-46c9-b230-5504319f5b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:07.180609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1431/2841] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:37:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:37:07.191438 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2480bf-0cdb-4be8-86a8-ee3d36123cc6 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:07.193329 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-0c2480bf-0cdb-4be8-86a8-ee3d36123cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:07.250704 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2480bf-0cdb-4be8-86a8-ee3d36123cc6 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:07.254508 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c26c-bbda-465a-b0a5-37866b0ae5ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:07.255153 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c26c-bbda-465a-b0a5-37866b0ae5ee service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:07.255498 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c26c-bbda-465a-b0a5-37866b0ae5ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:07.255709 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c26c-bbda-465a-b0a5-37866b0ae5ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:07.265044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c26c-bbda-465a-b0a5-37866b0ae5ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:07.266474 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c26c-bbda-465a-b0a5-37866b0ae5ee service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:07.275952 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1411/2842] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:37:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:37:07.295806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e4b43-1093-46c9-b230-5504319f5b63 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:07.362314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e4b43-1093-46c9-b230-5504319f5b63 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:07.366980 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:07.367824 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:07.368135 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:07.368976 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] PATH_INFO: `/v3/users/921521d3ee17401c9e1e635c58d1e2ba` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:07.370280 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=921521d3ee17401c9e1e635c58d1e2ba)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:07.372222 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:07.420789 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '921521d3ee17401c9e1e635c58d1e2ba'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:07.433289 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '921521d3ee17401c9e1e635c58d1e2ba'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:07.434120 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '921521d3ee17401c9e1e635c58d1e2ba'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:07.440826 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '921521d3ee17401c9e1e635c58d1e2ba'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:07.448321 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '921521d3ee17401c9e1e635c58d1e2ba'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:07.454167 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1432/2843] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:37:07 2022] DELETE /identity/v3/users/921521d3ee17401c9e1e635c58d1e2ba => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:37:07.459278 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285ca02-78ad-44b4-ba94-9689bff0d433 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:07.459566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285ca02-78ad-44b4-ba94-9689bff0d433 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:07.459895 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285ca02-78ad-44b4-ba94-9689bff0d433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:07.477511 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-6285ca02-78ad-44b4-ba94-9689bff0d433 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:37:07.478951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6285ca02-78ad-44b4-ba94-9689bff0d433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:07.541044 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1412/2844] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:37:07.551044 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:07.552502 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:07.621374 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8ab27-80f6-4fcd-aee4-cf5c4140e306 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:07.625414 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb6edd-22e8-43a7-92b8-d144a18eedc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:07.626063 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb6edd-22e8-43a7-92b8-d144a18eedc5 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:07.626341 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb6edd-22e8-43a7-92b8-d144a18eedc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:07.626610 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb6edd-22e8-43a7-92b8-d144a18eedc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:07.636441 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb6edd-22e8-43a7-92b8-d144a18eedc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:07.637888 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb6edd-22e8-43a7-92b8-d144a18eedc5 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:07.652499 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1433/2845] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:37:07.911339 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285ca02-78ad-44b4-ba94-9689bff0d433 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:07.912841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-6285ca02-78ad-44b4-ba94-9689bff0d433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:07.927991 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285ca02-78ad-44b4-ba94-9689bff0d433 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:07.933569 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0244db-97b8-4250-a295-1a8d9d49768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:07.934427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0244db-97b8-4250-a295-1a8d9d49768d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:07.934734 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0244db-97b8-4250-a295-1a8d9d49768d admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:07.935008 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0244db-97b8-4250-a295-1a8d9d49768d admin admin] PATH_INFO: `/v3/projects/dc0dfddd2fb54e0d859e11e40aaeb15d` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:07.936301 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0244db-97b8-4250-a295-1a8d9d49768d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc0dfddd2fb54e0d859e11e40aaeb15d)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:07.938256 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0244db-97b8-4250-a295-1a8d9d49768d admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:07.983397 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-dd0244db-97b8-4250-a295-1a8d9d49768d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc0dfddd2fb54e0d859e11e40aaeb15d', 'request_id': 'req-dd0244db-97b8-4250-a295-1a8d9d49768d'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:07.988649 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-dd0244db-97b8-4250-a295-1a8d9d49768d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc0dfddd2fb54e0d859e11e40aaeb15d', 'request_id': 'req-dd0244db-97b8-4250-a295-1a8d9d49768d'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:07.995685 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-dd0244db-97b8-4250-a295-1a8d9d49768d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc0dfddd2fb54e0d859e11e40aaeb15d', 'request_id': 'req-dd0244db-97b8-4250-a295-1a8d9d49768d'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:08.008185 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-dd0244db-97b8-4250-a295-1a8d9d49768d admin admin] The token cache is being invalidate because project dc0dfddd2fb54e0d859e11e40aaeb15d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:37:08.008472 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-dd0244db-97b8-4250-a295-1a8d9d49768d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:08.009656 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-dd0244db-97b8-4250-a295-1a8d9d49768d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:08.011450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1413/2846] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:37:07 2022] DELETE /identity/v3/projects/dc0dfddd2fb54e0d859e11e40aaeb15d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:37:08.016749 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8d789-36eb-446c-94c2-15a61d194856 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:08.016749 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8d789-36eb-446c-94c2-15a61d194856 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:08.017236 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8d789-36eb-446c-94c2-15a61d194856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:08.035041 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-65b8d789-36eb-446c-94c2-15a61d194856 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:37:08.036271 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-65b8d789-36eb-446c-94c2-15a61d194856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:08.093718 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1434/2847] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:37:08.101450 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860b09d-b698-4cfe-aed3-15176e50fb88 None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:08.101951 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860b09d-b698-4cfe-aed3-15176e50fb88 None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:08.102051 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860b09d-b698-4cfe-aed3-15176e50fb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:08.120843 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-b860b09d-b698-4cfe-aed3-15176e50fb88 None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:37:08.122027 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-b860b09d-b698-4cfe-aed3-15176e50fb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:08.129805 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1414/2848] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:37:08.134038 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8d789-36eb-446c-94c2-15a61d194856 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:08.143346 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8d789-36eb-446c-94c2-15a61d194856 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:08.147779 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182abcb-f7c9-46b0-8b17-ecf610015856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:08.148448 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182abcb-f7c9-46b0-8b17-ecf610015856 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:08.148726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182abcb-f7c9-46b0-8b17-ecf610015856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:08.148995 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182abcb-f7c9-46b0-8b17-ecf610015856 admin admin] PATH_INFO: `/v3/domains` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:08.150330 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182abcb-f7c9-46b0-8b17-ecf610015856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 09:37:08.150703 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182abcb-f7c9-46b0-8b17-ecf610015856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:08.152403 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182abcb-f7c9-46b0-8b17-ecf610015856 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:08.163374 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1435/2849] 10.222.0.90 () {58 vars in 1152 bytes} [Wed Feb 16 09:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 09:37:08.168056 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860b09d-b698-4cfe-aed3-15176e50fb88 None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:08.177348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860b09d-b698-4cfe-aed3-15176e50fb88 None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:08.182213 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad5cd7-9117-4d88-80ce-e95722e4b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:08.182872 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad5cd7-9117-4d88-80ce-e95722e4b00b admin admin] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:08.183150 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad5cd7-9117-4d88-80ce-e95722e4b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:08.183637 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad5cd7-9117-4d88-80ce-e95722e4b00b admin admin] PATH_INFO: `/v3/projects` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:08.184219 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad5cd7-9117-4d88-80ce-e95722e4b00b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:08.186092 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad5cd7-9117-4d88-80ce-e95722e4b00b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:08.210080 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1415/2850] 10.222.0.90 () {60 vars in 1152 bytes} [Wed Feb 16 09:37:08 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 09:37:08.214806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182abcb-f7c9-46b0-8b17-ecf610015856 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:08.224480 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182abcb-f7c9-46b0-8b17-ecf610015856 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:08.277938 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ada949-b220-45cf-9745-79f89374497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:08.278595 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ada949-b220-45cf-9745-79f89374497a admin admin] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:08.278876 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ada949-b220-45cf-9745-79f89374497a admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:08.279147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ada949-b220-45cf-9745-79f89374497a admin admin] PATH_INFO: `/v3/users` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:08.279833 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ada949-b220-45cf-9745-79f89374497a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:08.281768 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ada949-b220-45cf-9745-79f89374497a admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:08.301288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1436/2851] 10.222.0.90 () {60 vars in 1143 bytes} [Wed Feb 16 09:37:08 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 09:37:08.305478 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad5cd7-9117-4d88-80ce-e95722e4b00b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:08.316098 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad5cd7-9117-4d88-80ce-e95722e4b00b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:08.320727 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41155f4a-6714-4ad0-8036-9de55a402c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:08.321388 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41155f4a-6714-4ad0-8036-9de55a402c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:08.321765 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41155f4a-6714-4ad0-8036-9de55a402c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:08.322192 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41155f4a-6714-4ad0-8036-9de55a402c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:08.322906 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41155f4a-6714-4ad0-8036-9de55a402c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:08.324548 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41155f4a-6714-4ad0-8036-9de55a402c46 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:08.335138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1416/2852] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:37:08.339828 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ada949-b220-45cf-9745-79f89374497a admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:08.349520 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ada949-b220-45cf-9745-79f89374497a admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:08.354846 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578c3bf-c76d-4f06-9062-d554f6a0baf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:08.355481 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578c3bf-c76d-4f06-9062-d554f6a0baf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:08.355764 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578c3bf-c76d-4f06-9062-d554f6a0baf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:08.356062 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578c3bf-c76d-4f06-9062-d554f6a0baf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:08.356783 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578c3bf-c76d-4f06-9062-d554f6a0baf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:08.358351 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578c3bf-c76d-4f06-9062-d554f6a0baf7 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:08.367916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1437/2853] 10.222.0.90 () {58 vars in 1121 bytes} [Wed Feb 16 09:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 09:37:08.372079 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41155f4a-6714-4ad0-8036-9de55a402c46 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:08.381853 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41155f4a-6714-4ad0-8036-9de55a402c46 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:08.386545 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb6a15-2f4a-4acb-9f25-821a7948cd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:08.387403 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb6a15-2f4a-4acb-9f25-821a7948cd3b admin admin] REQUEST_METHOD: `PUT` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:08.387684 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb6a15-2f4a-4acb-9f25-821a7948cd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:08.387957 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb6a15-2f4a-4acb-9f25-821a7948cd3b admin admin] PATH_INFO: `/v3/projects/813b6802f8d545f2b1bf9117708b769e/users/ff1f2c15cfaa482099b10d22c33f2b2f/roles/4184b38195d04c3a88c76c1255f7c7f7` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:08.404197 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb6a15-2f4a-4acb-9f25-821a7948cd3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=813b6802f8d545f2b1bf9117708b769e, user_id=ff1f2c15cfaa482099b10d22c33f2b2f, role_id=4184b38195d04c3a88c76c1255f7c7f7)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:08.406859 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb6a15-2f4a-4acb-9f25-821a7948cd3b admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:08.420367 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1417/2854] 10.222.0.90 () {60 vars in 1482 bytes} [Wed Feb 16 09:37:08 2022] PUT /identity/v3/projects/813b6802f8d545f2b1bf9117708b769e/users/ff1f2c15cfaa482099b10d22c33f2b2f/roles/4184b38195d04c3a88c76c1255f7c7f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:37:08.430934 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592965e-672d-4248-9140-cf212e6bcf5b None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:08.431356 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592965e-672d-4248-9140-cf212e6bcf5b None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:08.431807 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592965e-672d-4248-9140-cf212e6bcf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:08.459451 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-a592965e-672d-4248-9140-cf212e6bcf5b None None] MFA Rules not processed for user `ff1f2c15cfaa482099b10d22c33f2b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:37:08.460729 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a592965e-672d-4248-9140-cf212e6bcf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:08.526110 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1438/2855] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:37:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:37:08.536002 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb6a15-2f4a-4acb-9f25-821a7948cd3b admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:08.537996 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-55cb6a15-2f4a-4acb-9f25-821a7948cd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:08.600846 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb6a15-2f4a-4acb-9f25-821a7948cd3b admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:08.605194 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71a7cf-4f3d-4547-a01a-4305bf2b9213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96e6c68eee11421bbb6b4066a856f228', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:08.606053 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71a7cf-4f3d-4547-a01a-4305bf2b9213 service cinder] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:08.606529 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71a7cf-4f3d-4547-a01a-4305bf2b9213 service cinder] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:08.606949 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71a7cf-4f3d-4547-a01a-4305bf2b9213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:08.615913 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71a7cf-4f3d-4547-a01a-4305bf2b9213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:08.617389 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71a7cf-4f3d-4547-a01a-4305bf2b9213 service cinder] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:08.626884 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1418/2856] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:37:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:37:23.403403 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592965e-672d-4248-9140-cf212e6bcf5b None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:23.466237 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592965e-672d-4248-9140-cf212e6bcf5b None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:23.470804 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:23.471692 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:23.471969 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:23.472270 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] PATH_INFO: `/v3/users/ff1f2c15cfaa482099b10d22c33f2b2f` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:23.473481 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1f2c15cfaa482099b10d22c33f2b2f)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:23.475424 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:23.523307 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1f2c15cfaa482099b10d22c33f2b2f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:23.534605 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1f2c15cfaa482099b10d22c33f2b2f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:23.535275 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1f2c15cfaa482099b10d22c33f2b2f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:23.543427 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1f2c15cfaa482099b10d22c33f2b2f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:23.550594 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1f2c15cfaa482099b10d22c33f2b2f'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:23.556453 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1439/2857] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:37:23 2022] DELETE /identity/v3/users/ff1f2c15cfaa482099b10d22c33f2b2f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:37:23.560924 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031fc1d-6545-40fe-8da3-b881d4e1118e None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:23.561415 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031fc1d-6545-40fe-8da3-b881d4e1118e None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:23.561510 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031fc1d-6545-40fe-8da3-b881d4e1118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:23.579228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-c031fc1d-6545-40fe-8da3-b881d4e1118e None None] MFA Rules not processed for user `7b109de6a86e43399a6192c2887dcf96`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:37:23.580460 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c031fc1d-6545-40fe-8da3-b881d4e1118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:23.637785 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1419/2858] 10.222.0.90 () {58 vars in 957 bytes} [Wed Feb 16 09:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:37:23.647279 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:23.648726 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:23.704553 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e62c0-3f3f-46a1-99e5-b49c4938ea4d admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:23.708288 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5332-0241-46dc-92c1-7f75f80daf4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:23.708930 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5332-0241-46dc-92c1-7f75f80daf4f service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:23.709211 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5332-0241-46dc-92c1-7f75f80daf4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:23.709486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5332-0241-46dc-92c1-7f75f80daf4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:23.718932 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc5332-0241-46dc-92c1-7f75f80daf4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:23.720392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc5332-0241-46dc-92c1-7f75f80daf4f service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:23.730626 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1440/2859] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:37:23.992841 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031fc1d-6545-40fe-8da3-b881d4e1118e None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:23.994374 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c031fc1d-6545-40fe-8da3-b881d4e1118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:24.006231 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031fc1d-6545-40fe-8da3-b881d4e1118e None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:24.015370 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:24.016387 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:24.016672 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:24.016945 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] PATH_INFO: `/v3/projects/813b6802f8d545f2b1bf9117708b769e` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:24.018314 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=813b6802f8d545f2b1bf9117708b769e)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:24.020244 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:24.078193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813b6802f8d545f2b1bf9117708b769e', 'request_id': 'req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:24.083459 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813b6802f8d545f2b1bf9117708b769e', 'request_id': 'req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:24.090348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813b6802f8d545f2b1bf9117708b769e', 'request_id': 'req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:24.103274 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] The token cache is being invalidate because project 813b6802f8d545f2b1bf9117708b769e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:37:24.103566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:24.104249 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:24.105790 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1420/2860] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:37:23 2022] DELETE /identity/v3/projects/813b6802f8d545f2b1bf9117708b769e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:37:30.582671 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5332-0241-46dc-92c1-7f75f80daf4f service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:30.584210 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-dfdc5332-0241-46dc-92c1-7f75f80daf4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:30.597560 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5332-0241-46dc-92c1-7f75f80daf4f service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:30.653157 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:30.654050 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:30.654333 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:30.654609 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] PATH_INFO: `/v3/users/52506eb32d2f49e7aa4d6585b77c1917` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:30.655795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52506eb32d2f49e7aa4d6585b77c1917)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:30.657756 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:30.702851 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52506eb32d2f49e7aa4d6585b77c1917'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:30.714723 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52506eb32d2f49e7aa4d6585b77c1917'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:30.715529 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52506eb32d2f49e7aa4d6585b77c1917'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:30.722593 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52506eb32d2f49e7aa4d6585b77c1917'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:30.730032 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52506eb32d2f49e7aa4d6585b77c1917'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:30.735773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1441/2861] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:37:30 2022] DELETE /identity/v3/users/52506eb32d2f49e7aa4d6585b77c1917 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:37:30.905022 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:37:30.906473 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:37:30.919959 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41ad10-7906-4e7e-bbdf-8fa5f40741b5 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:37:30.976969 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:37:30.977879 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:37:30.978150 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:37:30.978426 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] PATH_INFO: `/v3/projects/d998345414e84cd98ace4a86cbc59561` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:37:30.979610 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d998345414e84cd98ace4a86cbc59561)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:37:30.981558 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:37:31.026941 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd998345414e84cd98ace4a86cbc59561', 'request_id': 'req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:31.032227 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd998345414e84cd98ace4a86cbc59561', 'request_id': 'req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:31.038413 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd998345414e84cd98ace4a86cbc59561', 'request_id': 'req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:31.050970 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] The token cache is being invalidate because project d998345414e84cd98ace4a86cbc59561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:37:31.051262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:31.051950 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:37:31.053787 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1421/2862] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:37:30 2022] DELETE /identity/v3/projects/d998345414e84cd98ace4a86cbc59561 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:38:23.159916 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:38:23.161479 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:23.216498 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5c2b2-619a-4261-b73b-58a43c579a65 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:38:23.262458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0b3b4-7b49-4256-8e90-a4a44655ccff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:38:23.263102 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0b3b4-7b49-4256-8e90-a4a44655ccff service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:38:23.263384 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0b3b4-7b49-4256-8e90-a4a44655ccff service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:38:23.263657 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0b3b4-7b49-4256-8e90-a4a44655ccff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:38:23.265767 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-85e0b3b4-7b49-4256-8e90-a4a44655ccff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:23.275020 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0b3b4-7b49-4256-8e90-a4a44655ccff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:38:23.276862 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0b3b4-7b49-4256-8e90-a4a44655ccff service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:38:23.285549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1442/2863] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:38:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:38:30.076995 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:38:30.078522 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:30.161193 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd0732-ac8d-4ca4-a746-7fc4b26dd766 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:38:30.168716 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518358ed-b096-4d95-9bcf-656f1a8619bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:38:30.169464 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518358ed-b096-4d95-9bcf-656f1a8619bb service nova] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:38:30.170405 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518358ed-b096-4d95-9bcf-656f1a8619bb service nova] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:38:30.170892 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518358ed-b096-4d95-9bcf-656f1a8619bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:38:30.172830 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-518358ed-b096-4d95-9bcf-656f1a8619bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:30.186842 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518358ed-b096-4d95-9bcf-656f1a8619bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:38:30.188573 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518358ed-b096-4d95-9bcf-656f1a8619bb service nova] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:38:30.201361 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1422/2864] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:38:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:38:30.289971 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0b3b4-7b49-4256-8e90-a4a44655ccff service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:38:30.291821 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-85e0b3b4-7b49-4256-8e90-a4a44655ccff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:30.303296 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0b3b4-7b49-4256-8e90-a4a44655ccff service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:38:30.308818 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db6793-8f49-44ee-ba98-3b48b79df03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:38:30.309469 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db6793-8f49-44ee-ba98-3b48b79df03a service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:38:30.309744 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db6793-8f49-44ee-ba98-3b48b79df03a service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:38:30.310195 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db6793-8f49-44ee-ba98-3b48b79df03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:38:30.312250 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d3db6793-8f49-44ee-ba98-3b48b79df03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:30.328596 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db6793-8f49-44ee-ba98-3b48b79df03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:38:30.330087 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db6793-8f49-44ee-ba98-3b48b79df03a service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:38:30.343166 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1443/2865] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:38:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:38:31.528995 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518358ed-b096-4d95-9bcf-656f1a8619bb service nova] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:38:31.538441 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518358ed-b096-4d95-9bcf-656f1a8619bb service nova] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:38:31.543311 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdddcbd-614b-45d0-a99e-2e71c1b1d974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:38:31.543942 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdddcbd-614b-45d0-a99e-2e71c1b1d974 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:38:31.544262 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdddcbd-614b-45d0-a99e-2e71c1b1d974 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:38:31.544540 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdddcbd-614b-45d0-a99e-2e71c1b1d974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:38:31.546560 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-cfdddcbd-614b-45d0-a99e-2e71c1b1d974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:31.560642 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdddcbd-614b-45d0-a99e-2e71c1b1d974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:38:31.562066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdddcbd-614b-45d0-a99e-2e71c1b1d974 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:38:31.573550 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1423/2866] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:38:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:38:32.444001 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db6793-8f49-44ee-ba98-3b48b79df03a service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:38:32.446082 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-d3db6793-8f49-44ee-ba98-3b48b79df03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:32.460009 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db6793-8f49-44ee-ba98-3b48b79df03a service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:38:32.466569 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f0e2c-8058-4d06-b950-3cd217b4d3aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:38:32.467219 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f0e2c-8058-4d06-b950-3cd217b4d3aa service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:38:32.467495 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f0e2c-8058-4d06-b950-3cd217b4d3aa service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:38:32.467823 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f0e2c-8058-4d06-b950-3cd217b4d3aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:38:32.469648 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-793f0e2c-8058-4d06-b950-3cd217b4d3aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:32.484992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f0e2c-8058-4d06-b950-3cd217b4d3aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:38:32.486968 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f0e2c-8058-4d06-b950-3cd217b4d3aa service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:38:32.499587 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1444/2867] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:38:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 09:38:43.403538 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdddcbd-614b-45d0-a99e-2e71c1b1d974 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:38:43.404985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-cfdddcbd-614b-45d0-a99e-2e71c1b1d974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:43.416037 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdddcbd-614b-45d0-a99e-2e71c1b1d974 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:38:43.419759 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfca5f-419b-4afc-aab9-5b9ce3a3bdf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:38:43.420427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfca5f-419b-4afc-aab9-5b9ce3a3bdf5 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:38:43.420735 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfca5f-419b-4afc-aab9-5b9ce3a3bdf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:38:43.421013 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfca5f-419b-4afc-aab9-5b9ce3a3bdf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:38:43.422754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-72bfca5f-419b-4afc-aab9-5b9ce3a3bdf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:43.487224 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bfca5f-419b-4afc-aab9-5b9ce3a3bdf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:38:43.488696 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bfca5f-419b-4afc-aab9-5b9ce3a3bdf5 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:38:43.498634 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1424/2868] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:38:49.701567 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f0e2c-8058-4d06-b950-3cd217b4d3aa service nova] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:38:49.703848 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-793f0e2c-8058-4d06-b950-3cd217b4d3aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:49.719574 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f0e2c-8058-4d06-b950-3cd217b4d3aa service nova] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:38:49.724247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:38:49.725674 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:38:49.725978 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:38:49.726430 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] PATH_INFO: `/v3/users/e277c102c82b412481a8a9f888f4a7c7` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:38:49.744670 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e277c102c82b412481a8a9f888f4a7c7)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:38:49.746657 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:38:49.793126 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e277c102c82b412481a8a9f888f4a7c7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:49.804573 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e277c102c82b412481a8a9f888f4a7c7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:49.805258 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e277c102c82b412481a8a9f888f4a7c7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:49.812486 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e277c102c82b412481a8a9f888f4a7c7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:49.819746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e277c102c82b412481a8a9f888f4a7c7'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:49.825806 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1445/2869] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:38:49 2022] DELETE /identity/v3/users/e277c102c82b412481a8a9f888f4a7c7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:38:49.995644 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfca5f-419b-4afc-aab9-5b9ce3a3bdf5 service neutron] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:38:50.005985 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bfca5f-419b-4afc-aab9-5b9ce3a3bdf5 service neutron] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:38:50.065827 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:38:50.066576 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:38:50.066852 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:38:50.067117 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] PATH_INFO: `/v3/projects/690745bb6b6d4a1d8e021f08b9370685` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:38:50.077678 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690745bb6b6d4a1d8e021f08b9370685)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:38:50.079570 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:38:50.124006 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690745bb6b6d4a1d8e021f08b9370685', 'request_id': 'req-7334d0a6-b6e4-4581-8afa-25b802b83102'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.129516 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690745bb6b6d4a1d8e021f08b9370685', 'request_id': 'req-7334d0a6-b6e4-4581-8afa-25b802b83102'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.137135 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690745bb6b6d4a1d8e021f08b9370685', 'request_id': 'req-7334d0a6-b6e4-4581-8afa-25b802b83102'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.148997 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] The token cache is being invalidate because project 690745bb6b6d4a1d8e021f08b9370685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:38:50.149279 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.149899 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.151411 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1425/2870] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:38:49 2022] DELETE /identity/v3/projects/690745bb6b6d4a1d8e021f08b9370685 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:38:50.155494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:38:50.156952 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:50.170349 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3d11a-ef07-4ce9-a24b-42ae9ab19d11 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:38:50.235311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:38:50.236246 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:38:50.236527 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:38:50.236801 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] PATH_INFO: `/v3/users/3232866e556a4c1889ee521ae0ab3983` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:38:50.249752 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] RBAC: Authorizing `identity:delete_user(user_id=3232866e556a4c1889ee521ae0ab3983)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:38:50.251669 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:38:50.294842 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3232866e556a4c1889ee521ae0ab3983'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.305793 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3232866e556a4c1889ee521ae0ab3983'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.306443 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3232866e556a4c1889ee521ae0ab3983'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.313643 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3232866e556a4c1889ee521ae0ab3983'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.320857 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3232866e556a4c1889ee521ae0ab3983'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.326458 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1446/2871] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:38:50 2022] DELETE /identity/v3/users/3232866e556a4c1889ee521ae0ab3983 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:38:50.494986 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:38:50.496506 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:38:50.510323 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334d0a6-b6e4-4581-8afa-25b802b83102 admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:38:50.567228 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd8502-ecba-4b6f-8590-26eec7e3ae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:38:50.568116 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd8502-ecba-4b6f-8590-26eec7e3ae02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:38:50.568394 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd8502-ecba-4b6f-8590-26eec7e3ae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:38:50.568665 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd8502-ecba-4b6f-8590-26eec7e3ae02 admin admin] PATH_INFO: `/v3/projects/9d072d981d204ad2be5592d7ff1c2b4b` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:38:50.579100 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd8502-ecba-4b6f-8590-26eec7e3ae02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d072d981d204ad2be5592d7ff1c2b4b)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:38:50.581105 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd8502-ecba-4b6f-8590-26eec7e3ae02 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:38:50.626605 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-17fd8502-ecba-4b6f-8590-26eec7e3ae02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d072d981d204ad2be5592d7ff1c2b4b', 'request_id': 'req-17fd8502-ecba-4b6f-8590-26eec7e3ae02'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.632272 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-17fd8502-ecba-4b6f-8590-26eec7e3ae02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d072d981d204ad2be5592d7ff1c2b4b', 'request_id': 'req-17fd8502-ecba-4b6f-8590-26eec7e3ae02'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.638586 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-17fd8502-ecba-4b6f-8590-26eec7e3ae02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d072d981d204ad2be5592d7ff1c2b4b', 'request_id': 'req-17fd8502-ecba-4b6f-8590-26eec7e3ae02'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.651490 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-17fd8502-ecba-4b6f-8590-26eec7e3ae02 admin admin] The token cache is being invalidate because project 9d072d981d204ad2be5592d7ff1c2b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:38:50.651773 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-17fd8502-ecba-4b6f-8590-26eec7e3ae02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.652408 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-17fd8502-ecba-4b6f-8590-26eec7e3ae02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:38:50.653928 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1426/2872] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:38:50 2022] DELETE /identity/v3/projects/9d072d981d204ad2be5592d7ff1c2b4b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:39:13.313796 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:39:13.315293 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:39:13.370576 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148ddd5-fffd-487e-af36-cec93f1155de admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:39:13.418549 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6c5ac-ae8a-48b1-bfa3-d8a88d0d0ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:39:13.419193 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6c5ac-ae8a-48b1-bfa3-d8a88d0d0ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:39:13.419473 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6c5ac-ae8a-48b1-bfa3-d8a88d0d0ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:39:13.419746 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6c5ac-ae8a-48b1-bfa3-d8a88d0d0ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:39:13.421578 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-f6d6c5ac-ae8a-48b1-bfa3-d8a88d0d0ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:39:13.431489 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6c5ac-ae8a-48b1-bfa3-d8a88d0d0ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:39:13.432954 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6c5ac-ae8a-48b1-bfa3-d8a88d0d0ab1 service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:39:13.440751 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1447/2873] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:39:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:39:13.542979 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdc634-862f-4b8f-bdce-6374a95cfbaa None None] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:39:13.543566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdc634-862f-4b8f-bdce-6374a95cfbaa None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:39:13.543566 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdc634-862f-4b8f-bdce-6374a95cfbaa None None] PATH_INFO: `/` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:39:13.545360 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1427/2874] 10.222.0.90 () {54 vars in 921 bytes} [Wed Feb 16 09:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 09:39:13.551992 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b7fb0-4a19-4aa0-bebb-95e2051407c9 None None] REQUEST_METHOD: `POST` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:39:13.553057 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b7fb0-4a19-4aa0-bebb-95e2051407c9 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:39:13.553429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b7fb0-4a19-4aa0-bebb-95e2051407c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:39:13.572147 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.auth.core [None req-bd3b7fb0-4a19-4aa0-bebb-95e2051407c9 None None] MFA Rules not processed for user `39d5d18c09054343b4e000950ba875fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:39:13.573359 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-bd3b7fb0-4a19-4aa0-bebb-95e2051407c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:39:13.579883 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1448/2875] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Feb 16 09:39:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:39:13.592149 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdc634-862f-4b8f-bdce-6374a95cfbaa None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:39:13.593958 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8efdc634-862f-4b8f-bdce-6374a95cfbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:39:13.607590 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdc634-862f-4b8f-bdce-6374a95cfbaa None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:39:13.611287 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aabd88-ddbc-46d8-afb4-a78af94fda33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:39:13.611984 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aabd88-ddbc-46d8-afb4-a78af94fda33 service neutron] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:39:13.612354 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aabd88-ddbc-46d8-afb4-a78af94fda33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:39:13.612713 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aabd88-ddbc-46d8-afb4-a78af94fda33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:39:13.620989 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aabd88-ddbc-46d8-afb4-a78af94fda33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:39:13.622409 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aabd88-ddbc-46d8-afb4-a78af94fda33 service neutron] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:39:13.630201 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1428/2876] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:39:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:39:13.974065 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bf06d-684c-4f82-b4d4-f7c17bac7c62 None None] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:39:13.974388 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bf06d-684c-4f82-b4d4-f7c17bac7c62 None None] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:39:13.974773 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bf06d-684c-4f82-b4d4-f7c17bac7c62 None None] PATH_INFO: `/` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:39:13.976608 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1449/2877] 10.222.0.90 () {54 vars in 921 bytes} [Wed Feb 16 09:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 09:39:13.982505 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f54cc-068a-4187-b045-f5fdf03123ff None None] REQUEST_METHOD: `POST` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:39:13.982791 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f54cc-068a-4187-b045-f5fdf03123ff None None] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:39:13.983066 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f54cc-068a-4187-b045-f5fdf03123ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:39:14.001432 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.auth.core [None req-8f1f54cc-068a-4187-b045-f5fdf03123ff None None] MFA Rules not processed for user `9801d0694ec54d65bdd5b8914e05637e`. Rule list: `[]` (Enabled: `True`). {{(pid=79275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 09:39:14.002619 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8f1f54cc-068a-4187-b045-f5fdf03123ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:39:14.070280 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1429/2878] 10.222.0.90 () {58 vars in 1018 bytes} [Wed Feb 16 09:39:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 09:39:14.080607 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bf06d-684c-4f82-b4d4-f7c17bac7c62 None None] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:39:14.091939 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bf06d-684c-4f82-b4d4-f7c17bac7c62 None None] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:39:14.095543 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418594-4569-4767-8804-b9f9d7be127f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39d5d18c09054343b4e000950ba875fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:39:14.096208 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418594-4569-4767-8804-b9f9d7be127f service neutron] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:39:14.096494 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418594-4569-4767-8804-b9f9d7be127f service neutron] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:39:14.096771 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418594-4569-4767-8804-b9f9d7be127f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:39:14.107311 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f418594-4569-4767-8804-b9f9d7be127f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:39:14.108789 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f418594-4569-4767-8804-b9f9d7be127f service neutron] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:39:14.121091 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1450/2879] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:39:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:39:14.180509 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f54cc-068a-4187-b045-f5fdf03123ff None None] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:39:14.181911 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-8f1f54cc-068a-4187-b045-f5fdf03123ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:39:14.246925 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f54cc-068a-4187-b045-f5fdf03123ff None None] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:39:14.251939 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3c021-26fa-4565-bf46-adda5a843cae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d870fbd90cb4fde9ceafd2b737795eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:39:14.252604 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3c021-26fa-4565-bf46-adda5a843cae service placement] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:39:14.252890 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3c021-26fa-4565-bf46-adda5a843cae service placement] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:39:14.253170 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3c021-26fa-4565-bf46-adda5a843cae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:39:14.254926 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-3bf3c021-26fa-4565-bf46-adda5a843cae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:39:14.266240 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3c021-26fa-4565-bf46-adda5a843cae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:39:14.267818 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3c021-26fa-4565-bf46-adda5a843cae service placement] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:39:14.278096 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1430/2880] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:39:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:39:16.294864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418594-4569-4767-8804-b9f9d7be127f service neutron] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:39:16.296472 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-4f418594-4569-4767-8804-b9f9d7be127f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:39:16.314008 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418594-4569-4767-8804-b9f9d7be127f service neutron] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:39:16.320679 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e3298-1d5b-4639-863f-ce572ede7f8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9801d0694ec54d65bdd5b8914e05637e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:39:16.321315 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e3298-1d5b-4639-863f-ce572ede7f8b service nova] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:39:16.321592 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e3298-1d5b-4639-863f-ce572ede7f8b service nova] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:39:16.321864 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e3298-1d5b-4639-863f-ce572ede7f8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:39:16.323622 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c41e3298-1d5b-4639-863f-ce572ede7f8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:39:16.343893 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e3298-1d5b-4639-863f-ce572ede7f8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:39:16.345508 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e3298-1d5b-4639-863f-ce572ede7f8b service nova] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:39:16.357534 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1451/2881] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:39:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:40:27.439016 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3c021-26fa-4565-bf46-adda5a843cae service placement] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:40:27.440426 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-3bf3c021-26fa-4565-bf46-adda5a843cae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:40:27.522782 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3c021-26fa-4565-bf46-adda5a843cae service placement] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:40:27.527875 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa8a88-6bc6-48de-b716-ae272817f0db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d870fbd90cb4fde9ceafd2b737795eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:40:27.528534 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa8a88-6bc6-48de-b716-ae272817f0db service placement] REQUEST_METHOD: `GET` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:40:27.528811 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa8a88-6bc6-48de-b716-ae272817f0db service placement] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:40:27.529083 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa8a88-6bc6-48de-b716-ae272817f0db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:40:27.530832 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c1fa8a88-6bc6-48de-b716-ae272817f0db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:40:27.542318 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa8a88-6bc6-48de-b716-ae272817f0db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:40:27.543902 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa8a88-6bc6-48de-b716-ae272817f0db service placement] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:40:27.555138 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1431/2882] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:40:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 09:40:48.351908 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e3298-1d5b-4639-863f-ce572ede7f8b service nova] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:40:48.353503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-c41e3298-1d5b-4639-863f-ce572ede7f8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:40:48.477825 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e3298-1d5b-4639-863f-ce572ede7f8b service nova] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:40:48.482392 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:40:48.483247 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:40:48.483524 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:40:48.483795 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] PATH_INFO: `/v3/users/0769c8d8378c4f5dbfb7d1de62e6e5cf` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:40:48.485012 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0769c8d8378c4f5dbfb7d1de62e6e5cf)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:40:48.487003 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:40:48.531702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0769c8d8378c4f5dbfb7d1de62e6e5cf'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:48.543879 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0769c8d8378c4f5dbfb7d1de62e6e5cf'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:48.544580 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0769c8d8378c4f5dbfb7d1de62e6e5cf'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:48.552072 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0769c8d8378c4f5dbfb7d1de62e6e5cf'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:48.558839 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0769c8d8378c4f5dbfb7d1de62e6e5cf'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:48.564579 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1452/2883] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:40:48 2022] DELETE /identity/v3/users/0769c8d8378c4f5dbfb7d1de62e6e5cf => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:40:48.731845 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa8a88-6bc6-48de-b716-ae272817f0db service placement] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:40:48.743439 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa8a88-6bc6-48de-b716-ae272817f0db service placement] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:40:48.800885 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:40:48.801725 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:40:48.802003 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:40:48.802273 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] PATH_INFO: `/v3/projects/facc2e90f7094144b7bce35e32b72941` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:40:48.803424 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] RBAC: Authorizing `identity:delete_project(project_id=facc2e90f7094144b7bce35e32b72941)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:40:48.805359 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:40:48.849746 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'facc2e90f7094144b7bce35e32b72941', 'request_id': 'req-c09d92ee-0d8a-4deb-beab-dca13e17471e'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:48.854894 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'facc2e90f7094144b7bce35e32b72941', 'request_id': 'req-c09d92ee-0d8a-4deb-beab-dca13e17471e'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:48.860754 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'facc2e90f7094144b7bce35e32b72941', 'request_id': 'req-c09d92ee-0d8a-4deb-beab-dca13e17471e'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:48.872146 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] The token cache is being invalidate because project facc2e90f7094144b7bce35e32b72941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:40:48.872427 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:48.873040 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:48.874549 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1432/2884] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:40:48 2022] DELETE /identity/v3/projects/facc2e90f7094144b7bce35e32b72941 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:40:48.879290 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:40:48.880702 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:40:48.894007 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d922f-6417-4801-8282-55eafc2e8cbe admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:40:48.947314 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:40:48.948223 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:40:48.948503 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:40:48.948775 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] PATH_INFO: `/v3/users/f7853b3d20144602a1e6d9741b81b3c4` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:40:48.949936 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7853b3d20144602a1e6d9741b81b3c4)` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:40:48.951823 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:40:48.995697 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7853b3d20144602a1e6d9741b81b3c4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:49.008551 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7853b3d20144602a1e6d9741b81b3c4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:49.009429 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7853b3d20144602a1e6d9741b81b3c4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:49.025077 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7853b3d20144602a1e6d9741b81b3c4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:49.032432 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.notifications [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7853b3d20144602a1e6d9741b81b3c4'} {{(pid=79276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:49.038663 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1453/2885] 10.222.0.90 () {58 vars in 1223 bytes} [Wed Feb 16 09:40:48 2022] DELETE /identity/v3/users/f7853b3d20144602a1e6d9741b81b3c4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 09:40:49.207953 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] Authenticating user token {{(pid=79275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:40:49.209417 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.fernet_utils [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:40:49.222179 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d92ee-0d8a-4deb-beab-dca13e17471e admin admin] Validating token access rules against request {{(pid=79275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:40:49.278821 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b109de6a86e43399a6192c2887dcf96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '452aa210ed214b4b8bc6178a127c766b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:40:49.279674 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:40:49.279955 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:40:49.280264 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53 admin admin] PATH_INFO: `/v3/projects/71a053c2fc2f46998bf82a62c1f9178e` {{(pid=79275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:40:49.281439 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a053c2fc2f46998bf82a62c1f9178e)` {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:40:49.283348 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53 admin admin] RBAC: Authorization granted {{(pid=79275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:40:49.329211 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a053c2fc2f46998bf82a62c1f9178e', 'request_id': 'req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:49.334701 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a053c2fc2f46998bf82a62c1f9178e', 'request_id': 'req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:49.340794 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a053c2fc2f46998bf82a62c1f9178e', 'request_id': 'req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53'} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:49.352553 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53 admin admin] The token cache is being invalidate because project 71a053c2fc2f46998bf82a62c1f9178e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 09:40:49.352869 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:49.353517 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: DEBUG keystone.notifications [None req-13e5ef7b-015a-4b1e-a64a-a5b8e86c9f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 09:40:49.355046 dv-cinder-828459-1-iscsi devstack@keystone.service[79275]: [pid: 79275|app: 0|req: 1433/2886] 10.222.0.90 () {58 vars in 1232 bytes} [Wed Feb 16 09:40:49 2022] DELETE /identity/v3/projects/71a053c2fc2f46998bf82a62c1f9178e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 09:45:33.407366 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] Authenticating user token {{(pid=79276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 09:45:33.409034 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:45:33.478935 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952daa08-4708-4e9a-834a-c42b97e496b9 admin admin] Validating token access rules against request {{(pid=79276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 09:45:33.536511 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33976533-d030-4155-b874-0c1bd0494236 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d870fbd90cb4fde9ceafd2b737795eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '936ab51e6e2745658b252fbafdc2f8ef', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 09:45:33.537165 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976533-d030-4155-b874-0c1bd0494236 service placement] REQUEST_METHOD: `GET` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 09:45:33.538927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976533-d030-4155-b874-0c1bd0494236 service placement] SCRIPT_NAME: `/identity` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 09:45:33.538927 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976533-d030-4155-b874-0c1bd0494236 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 09:45:33.541358 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.fernet_utils [None req-33976533-d030-4155-b874-0c1bd0494236 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 09:45:33.553899 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33976533-d030-4155-b874-0c1bd0494236 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 09:45:33.555664 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33976533-d030-4155-b874-0c1bd0494236 service placement] RBAC: Authorization granted {{(pid=79276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 09:45:33.565475 dv-cinder-828459-1-iscsi devstack@keystone.service[79276]: [pid: 79276|app: 0|req: 1454/2887] 10.222.0.90 () {60 vars in 1365 bytes} [Wed Feb 16 09:45:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)